Knowledge exchange processes in organizations and policy arenas: a narrative systematic review of the literature

Sex Offender Recidivism: Some Lessons Learned From Over 70 Years of Research

Sex offender recidivism (SOR) has been the subject of research for over 70 years. Myths, misconceptions, and erroneous conclusions about SOR, however, remain widespread, impeding the development of evidence-based policies aimed at preventing sexual offenses. To address the rich but uneven literature, a comprehensive review was conducted making it possible to provide a contextualized overview of scientific knowledge against the backdrop of methodological issues, challenges, and shortcomings. Over the years, researchers have been asked to provide a simple answer to a seemingly simple question: what are the recidivism rates for sexual offending? In response, the field has produced a wide range of findings making it difficult to draw firm conclusions, leaving room for interpretation and personal biases. The variations in recidivism rates are attributable to offender and methodological characteristics, both of which are embedded in a particular sociolegal context. As a result, the base rate of SOR is more effectively considered in terms of a series of questions that should include the type of recidivism, with whom, over what period, and in what context. Issues and debates that have marked the field and fueled its growth are highlighted. Research innovations and important areas of research are also discussed.

Use of research evidence in U.S. federal policymaking: A reflexive report on intra-stage mixed methods

The policymaking process is largely opaque, especially regarding the actual writing of the policy. To attempt to better understand this complex process, we utilized mixed methods in our evaluation of an intervention. However, the process of mixing methods can be messy, and thus may require recalibration during the evaluation itself. Yet, in comparison to reporting results, relatively little attention is paid to the effects of mixing methods on the evaluation process. In this article, we take a reflexive approach to reporting a mixed methods evaluation of an intervention on the use of research evidence in U.S. federal policymaking. We focus on the research process in a qualitative coding team, and the effects of mixing methods on that process. Additionally, we report in general terms how to interpret multinomial logistic regressions, an underused analysis type applicable to many evaluations. Thus, this reflexive piece contributes (1) findings from evaluation of the intervention on the policymaking process, (2) an example of mixing methods leading to unexpected findings and future directions, (3) a report about the evaluation process itself, and (4) a tutorial for those new to multinomial logistic regressions.

Scoping review of practice-focused resources to support the implementation of place-based approaches

ISSUE ADDRESSED

There is increasing interest across public health research, policy, and practice in place-based approaches to improve health outcomes. Practice-focused resources, such as grey literature, courses and websites, are utilised by practitioners to support the implementation of place-based approaches.

METHODS

A detailed search of two search engines: Google and DuckDuckGo to identify free practice-focused resources was conducted.

RESULTS

Forty-one resources met inclusion criteria, including 26 publications, 13 web-based resources and two courses. They were mainly focused on collaboration, developed by not-for-profit organisations, focused on a broad target audience, and supported people living with disadvantage. The publications we reviewed generally: clearly stated important information, such as the author of the publication; used their own evaluations, professional experience and other grey literature as supporting evidence; included specific, practical implementation strategies; and were easy to read.

CONCLUSIONS

Based on findings, we recommend that: (1) the development of resources to support evidence-informed practice and governance be prioritised; (2) resources clearly state their target audience and tailor communication to this audience; (3) resources draw on evidence from a range of sources; (4) resources continue to include practical implementation strategies supported by examples and (5) resource content be adaptable to different contexts (e.g., different settings and/or target populations). SO WHAT?: This is the first review of practice-focused resources to support the implementation of place-based approaches and the findings can be used to reduce duplication of efforts and inform future research, policy, and practice, particularly the refinement of existing resources and the development of future resources.

Overcoming Common Anxieties in Knowledge Translation: Advice for Scholarly Issue Advocates

Policy Points Faced with urgent threats to human health and well-being such as climate change, calls among the academic community are getting louder to contribute more effectively to the implementation of the evidence generated by our research into public policy. As interest in knowledge translation (KT) surges, so have a number of anxieties about the field's shortcomings. Our paper is motivated by a call in the literature to render useful advice for those beginning in KT on how to advance impact at a policy level. By integrating knowledge from fields such as political science, moral psychology, and marketing, we suggest that thinking and acting like marketers, lobbyists, movements, and political scientists would help us advance on the quest to bridge the chasm between evidence and policy.

Evidence-informed stakeholder consultations to promote rights-based approaches for children with disabilities

Purpose

To strengthen the translation of evidence to actionable policy, stakeholder engagement is necessary to synthesize, prioritize and contextualize the academic research content into accessible language. In this manuscript we describe a multi-level evidence-based stakeholder consultation process and related outcomes proposed to promote awareness of and foster cross-sectorial collaborations towards human rights-based approaches for children with disabilities.

Methods

Mixed-methods participatory action research done in three steps: (1) A literature review of peer-reviewed evidence on rights-based approaches in childhood disabilities; (2) Consultation with researchers in diverse fields, grassroot organizations, caregivers, and youth with disabilities; (3) A constructive dialogue with decision makers at federal and provincial levels in Canada to discuss consultations results.

Results

Stakeholders value human rights approaches that can have a direct impact on practical aspects of their daily living. Organizations give high importance to adopting rights-based approaches to measure policy outcomes, while parents value service provision and youth emphasize accessibility.

Conclusion

The implementation of rights-based approaches in childhood disabilities can support policy, services, and daily lives of children with disabilities and the ecosystems around them. It can also guide research priorities, and create a common language to foster collaborations across sectors and interested parties.

Collaborative sustainability planning for an outcome measure in outpatient stroke rehabilitation: A qualitative description study

RATIONALE

Evidence suggests that sustainability planning and the use of a collaborative approach to planning result in better sustainability outcomes and more relevant knowledge. Yet, both approaches appear to be underutilized. A detailed description of collaborative sustainability planning may encourage the use of these two impactful strategies.

AIMS AND OBJECTIVES

To explore the collaborative sustainability planning process for a single outcome measure in three rehabilitation sites.

METHODOLOGY

Within the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) implementation project, we conducted a qualitative description study. We used data from 12 core sustainability planning meetings and 108 follow-up meetings that included a total of 31 clinical and research team participants. Sustainability planning was informed by an MPAI-4-specific implementation guide, and by the results from a realist review of the sustainability of rehabilitation practices and the Clinical Sustainability Assessment Tool. We analyzed qualitative data using thematic content analysis.

RESULTS

Three themes describe the collaborative sustainability planning process: (1) "collaboration as a driver for sustainability" which captures the active collaboration underpinning sustainability planning; (2) "co-creation of a sustainability plan to achieve shared objectives" which captures the identified barriers and facilitators, and selected sustainability strategies linked to one of six collaboratively identified shared objectives; and (3) "the iterative nature of sustainability planning" which captures the necessity of an agile and responsive sustainability planning process.

CONCLUSION

Identified strategies may be useful to support (collaborative) sustainment. Future research could investigate the effect of collaborative sustainability planning on sustainability objectives, and the relationship between these objectives.

"I would not wait for them to commit crime": Cesare Lombroso's criminal anthropology in Croatia

Croatia is a Central European and Mediterranean country with a long maritime border with Italy. Throughout history, it was not only goods but also knowledge and medical practices that were exchanged over its borders. Following archival sources, individual informal networks, professional publications, daily newspapers, and public lectures, we aimed to present main channels by which Croatian intellectuals embraced Lombroso's criminal anthropology at the end of the 19th and the beginning of the 20th centuries. We illuminated the fact that the adoption of Cesare Lombroso's concepts stimulated the joint engagement and communication of medical and legal realms in Croatia. Our analysis exposed the traces of Lombroso's ideas within the reform of the penal code, thus influencing forensic psychiatric practice. We showed how those ideas were translated into policy, politically exploited, and pitched into discussions employing rhetorical techniques, which led to the stigmatization of certain groups of people, particularly patients suffering from epilepsy. Our results also showed that, contrary to other countries that formed Austria-Hungary, the discussions about Lombroso's criminology waned in Croatia after the First World War. We believe that our results can close the gap on this topic, adding the evidence about the spread and influence of Lombroso's concepts within Austria-Hungary in the analyzed period.

New trends in science communication fostering evidence-informed policymaking

This article aims to assess novel trends in science communication relating to how policymakers in the field of innovation and digitalisation policy consume and use scientific findings. We investigate the mutual influence that science communication and policy have on each other and answer the question how emerging science communication trends in the science-policy nexus might influence the use of scientific findings in the policymaking process. By using Google and the largest scholarly repositories, Google Scholar, ResearchGate, and Academia.edu, from 1 st March to 31 st May 2020, we reviewed policy documents and academic literature containing relevant information on the evolution of characteristics of global, European, and national science communication activities and the interrelated policy responses to identify the most relevant current trends in the evidence-to-policy process alongside three key challenges; trust, translation, and timing. The three identified main trends are (1) a stronger engagement between science and policy, (2) more open, reliable, and accountable science communication practices with policymakers, and (3) the increasing digitalisation and visualisation of science communication. We deepened our investigation by conducting online semi-structured interviews with relevant policy stakeholders at the international and national level between 1 st May and 31 st July 2020. With the support of the European Commission and building on the existing network of partners, we identified decision-makers and advisors with relevant experience in fields related to innovation and digitalisation policy working in four countries that represent different levels of generalized social trust: Austria, Italy, Hungary, and the Netherlands, and at the international/European Union level. After an online consultation process with a global set of policymakers, these theoretical findings were translated to policy recommendations showcasing possible solutions in science communication that may be initiated, strengthened, or continued by policy stakeholders in order to reach a more effective and efficient uptake of scientific findings in evidence-informed policymaking.

What facilitates or prevents academic fraud in a Colombian faculty of medicine-Protocol of a study using fuzzy cognitive mapping

INTRODUCTION

Academic fraud is any behavior that gives a student an undeserved advantage over another student. Few studies have explored the causes of and possible solutions to academic fraud in Latin America. We aim to map the knowledge of stakeholders in a Colombian faculty of medicine about the factors that facilitate and prevent academic fraud.

METHODS

Fuzzy cognitive mapping. We will use the approach proposed by Andersson and Silver to generate fuzzy cognitive maps representing stakeholder knowledge. This process consists of ten steps: (1) definition of the research question; (2) identification of participants; (3) generation of ideas; (4) rationalization of ideas; (5) organization and connection of ideas; (6) weighing; (7) pattern grouping; (8) list of links and digitization; (9) combination of maps and network analysis; and (10) deliberative dialogue. To draw the maps, we will invite medical students, interns, resident physicians, master's students, and professors in the faculty of medicine. Four medical students will receive training to facilitate the sessions. Participants will identify the factors contributing to academic fraud and their causal relationships. We will use a combination of network analysis and graph theory to identify the chains of factors with greatest influence on academic fraud.

CONCLUSION

The maps will serve to discuss strategies to reduce academic fraud in the Faculty of Medicine and to identify factors that could be addressed in other contexts with similar problems. This research will allow the students who facilitate mapping sessions to learn about research techniques, fuzzy cognitive mapping and academic fraud. Study registration: Registered in OSF Registries on August 2nd, 2022. Registration number: osf.io/v4amz.

Toward a Values-Informed Approach to Complexity in Health Care: Hermeneutic Review

Policy Points The concept of value complexity (complexity arising from differences in people's worldviews, interests, and values, leading to mistrust, misunderstanding, and conflict among stakeholders) is introduced and explained. Relevant literature from multiple disciplines is reviewed. Key theoretical themes, including power, conflict, language and framing, meaning-making, and collective deliberation, are identified. Simple rules derived from these theoretical themes are proposed.

Using evidence in mental health policy agenda-setting in low- and middle-income countries: a conceptual meta-framework from a scoping umbrella review

The purpose of this article is to close the gap in frameworks for the use of evidence in the mental health policy agenda-setting in low- and middle-income countries (LMICs). Agenda-setting is important because mental health remains a culturally sensitive and neglected issue in LMICs. Moreover, effective evidence-informed agenda-setting can help achieve, and sustain, the status of mental health as a policy priority in these low-resource contexts. A scoping 'review of reviews' of evidence-to-policy frameworks was conducted, which followed preferred reporting items for systematic reviews and meta-analyses (PRISMA) guidelines. Nineteen reviews met the inclusion criteria. A meta-framework was developed from analysis and narrative synthesis of these 19 reviews, which integrates the key elements identified across studies. It comprises the concepts of evidence, actors, process, context and approach, which are linked via the cross-cutting dimensions of beliefs, values and interests; capacity; power and politics; and trust and relationships. Five accompanying questions act as a guide for applying the meta-framework with relevance to mental health agenda-setting in LMICs. This is a novel and integrative meta-framework for mental health policy agenda-setting in LMICs and, as such, an important contribution to this under-researched area. Two major recommendations are identified from the development of the framework to enhance its implementation. First, given the paucity of formal evidence on mental health in LMICs, informal evidence based on stakeholder experience could be better utilized in these contexts. Second, the use of evidence in mental health agenda-setting in LMICs would be enhanced by involving a broader range of stakeholders in generating, communicating and promoting relevant information.

Why Is It So Hard to Evaluate Knowledge Exchange? Comment on "Sustaining Knowledge Translation Practices: A Critical Interpretive Synthesis"

Despite a growth in knowledge translation (KT) or exchange activities, and a smaller growth in their evaluations, it remains challenging to identify evidence of efficacy. This could be due to well-documented political and logistical difficulties involved in evaluating knowledge exchange interventions. By bringing in theory from science and technology studies (STS), Borst et al1 offer a new way of thinking about this problem. Most KT evaluations draw on health research traditions; centralising comparability, efficacy, and so on. Borst et al propose focusing on the work it takes to move knowledge over boundaries between these communities, seeing relationships as interactions, not just conduits for evidence. They show how 'context' can be understood as a mutual creation, not a static environment; and that institutions shape behaviours, rather than merely being sites or platforms for evidence mobilisation. Seeing KT as a creative, active practice opens new ways to design and evaluate KT mechanisms.

Examining the Preferences and Priorities of Dance Educators for Dance Science Information: A Pilot Study

The growing field of dance medicine and science provides dance educators the opportunity to incorporate evidence-based approaches into teaching practices. Incorporating knowledge produced by dance science research into evidence-based practice can improve learning and health outcomes for dance students. Assessing the preferences and priorities of knowledge users can benefit the uptake of research into practice and ensure that research aligns with the priorities of knowledge users. Guided by the Knowledge to Action (KTA) Framework, the purpose of this study was to examine the preferences and research priorities of dance educators for receiving, accessing, and implementing dance science knowledge. A convenience sample of 97 dance educators representing a range of styles, experience, and educational settings completed an online survey. Responses indicated that dance science was important to participants' teaching practices although there was variability in which dance science topics were seen as "Absolutely Essential." Participants reported a preference for receiving dance science information through in-person methods and observations. Variability was also shown in participant responses to statements about the accessibility, format, and applicability of dance science information to teaching practices. Dance educators indicated that the easiest dance science topics to find information about were anatomy, flexibility, biomechanics, and injury prevention; dance educators also identified that more research was needed in mental health and psychology. The findings of this survey provide key considerations for factors such as accessibility, specificity, and resources that are user-friendly to inform future knowledge translation efforts tailored to dance educators.

Barriers and facilitators to implementing evidence-based interventions in the context of a randomized clinical trial in the United States: a qualitative study

BACKGROUND

Evidence-based interventions, which are typically supported by data from randomized controlled trials (RCTs), are highly valued by providers of human services like child welfare. However, implementing such interventions in the context of a randomized clinical trial is a complex process, as conducting an RCT adds extra tasks for providers and complicating factors for provider organizations. Utilizing the Exploration, Preparation, Implementation, and Sustainment Framework, this study examines factors that facilitate or impede success in the implementation of evidence-based interventions in the context of a largescale trial of SafeCare,® a child maltreatment intervention.

METHODS

Qualitative data were obtained as part of a larger mixed-methods study involving a cluster randomized trial comparing SafeCare to usual services for caregivers within nine child welfare agencies across four states. Between May and October 2017, individual interviews were conducted with a purposive sample of 21 child welfare administrators and 24 supervisors, and 19 focus groups were conducted with 84 providers. Data were coded iteratively and grouped into themes.

RESULTS

Several interconnected themes centered on facilitators and barriers to SafeCare implementation in the context of a randomized clinical trial. Facilitators included: (1) Benefits afforded through RCT participation; (2) Shared vision and sustained buy-in across system and organizational levels; and (3) Ongoing leadership support for SafeCare and the RCT. Barriers that hindered SafeCare were: (1) Insufficient preparation to incorporate SafeCare into services; (2) Perceived lack of fit, leading to mixed support for SafeCare and the RCT; and (3) Requirements of RCT participation at the provider level.

CONCLUSIONS

These data yield insight into an array of stakeholder perspectives on the experience of implementing a new intervention in the context of a largescale trial. This research also sheds light on how the dynamics of conducting an RCT may affect efforts to implement interventions in complex and high-pressure contexts. Findings highlight the importance of aligning knowledge and expectations among researchers, administrators of organizations, and supervisors and providers. Researchers should work to alleviate the burdens of study involvement and promote buy-in among frontline staff not only for the program but also for the research itself.

How insights from the field of information behavior can enrich understanding of knowledge mobilization

PURPOSE

The authors review the literature on information behavior, an autonomous body of work developed mainly in library studies and compare it with work on knowledge mobilization. The aim is to explore how information behavior can contribute to understanding knowledge mobilization in healthcare management.

DESIGN/METHODOLOGY/APPROACH

The authors conducted a narrative review using an exploratory, nonkeyword "double-sided systematic snowball" method. This is especially useful in the situation when the two traditions targeted are broad and relies on distinct vocabulary.

FINDINGS

The authors find that the two bodies of work have followed similar trajectories and arrived at similar conclusions, with a linear view supplemented first by a social approach and then by a sensitivity to practice. Lessons from the field of information behavior can be used to avoid duplication of effort, repeating the same errors and reinventing the wheel among knowledge translation scholars. This includes, for example, focusing on sources of information or ignoring the mundane activities in which managers and policymakers are involved.

ORIGINALITY/VALUE

The study is the first known attempt to build bridges between the field of information behavior and the study of knowledge mobilization. The study, moreover, foregrounds the need to address knowledge mobilization in context-sensitive and social rather than technical terms, focusing on the mundane work performed by a variety of human and nonhuman agents.

Applying behaviour change models to policy-making: development and validation of the Policymakers' Information Use Questionnaire (POLIQ)

BACKGROUND

The purpose of this study was to develop and validate the Policymakers' Information Use Questionnaire (POLIQ) to capture the intention of individuals in decision-making positions, such as health policy-makers, to act on research-based evidence in order to inform theory and the application of behaviour change models to decision-making spheres.

METHODS

The development and validation comprised three steps: item generation, qualitative face validation with cognitive debriefing and factorial construct validation. Confirmatory factor analysis was applied to estimate item-domain correlations for five predefined constructs relating to content, beliefs, behaviour, control and intent. Cronbach's alpha coefficient was calculated to assess the overall consistency of questionnaire items with the predefined constructs. Participants in the item generation and face validation were health and policy researchers and two former decision-makers (former assistant deputy ministers) from the Canadian provincial level. Participants in the construct validation were 39 Canadian decision-makers at various positions of municipal, provincial and federal jurisdiction who participated in a series of policy dialogues focused on childhood disability.

RESULTS

Cognitive debriefing allowed for small adjustments in language for clarity, including simultaneous validation of the English and French questionnaires. Participants found that the questions were clear and addressed the domains being targeted. Internal consistency of items belonging to the respective questionnaire domains was moderate to high, with estimated Cronbach's alpha values ranging from 0.67 to 0.84. Estimated item-domain correlations indicated moderate to high measurement performance for the domains norm, control and beliefs, whereas weak to moderate correlations resulted for the constructs content and intent. Estimated imprecision of factor loadings (95% confidence interval widths) was considerable for the questionnaire domains content and intent.

CONCLUSION

Measuring decision-makers' behaviour in relation to research evidence use is challenging. We provide initial evidence on face validity and appropriate measurement properties of the POLIQ based on a convenience sample of decision-makers in social and health policy. Larger validation studies and further psychometric property testing will support further utility of the POLIQ.

Characterising performance information use in the primary healthcare systems of El Salvador, Lebanon and Malawi: multiple qualitative case study protocol

INTRODUCTION

Governments in low-income and middle-income countries (LMICs) and official development assistance agencies use a variety of performance measurement and management approaches to improve the performance of healthcare systems. The effectiveness of such approaches is contingent on the extent to which managers and care providers use performance information. To date, major knowledge gaps exist about the contextual factors that contribute, or not, to performance information use by primary healthcare (PHC) decision-makers in LMICs. This study will address three research questions: (1) How do decision-makers use performance information, and for what purposes? (2) What are the contextual factors that influence the use or non-use of performance information? and (3) What are the proximal outcomes reported by PHC decision-makers from performance information use?

METHODS AND ANALYSIS

We present the protocol of a theory-driven, qualitative study with a multiple case study design to be conducted in El Salvador, Lebanon and Malawi.Data sources include semi structured in-depth interviews and document review. Interviews will be conducted with approximately 60 respondents including PHC system decision-makers and providers. We follow an interdisciplinary theoretical framework that draws on health policy and systems research, public administration, organisational science and health service research. Data will be analysed using thematic analysis to explore how respondents use performance information or not, and for what purposes as well as barriers and facilitators of use.

ETHICS AND DISSEMINATION

The ethical boards of the participating universities approved the protocol presented here. Study results will be disseminated through peer-reviewed journals and global health conferences.

Examining and Contextualizing Approaches to Establish Policy Support Organizations - A Mixed Method Study

BACKGROUND

There has been an increase in the number of policy support organizations (PSOs) that have been created to foster the systematic use of evidence in health system policymaking. Our aim was to identify approaches for establishing a PSO or similar entities by soliciting insights from those with practical experience with developing and operationalizing PSOs in real-world contexts.

METHODS

We used a sequential mixed method approached. We first conducted a survey to identify the views and experiences of those who were directly involved in the establishment of PSOs that have been developed and implemented across a variety of political-, health- and research-system contexts. The survey findings were then used to develop a purposive sample of PSO leaders and refine an interview guide for interviews with them.

RESULTS

We received 19 completed surveys from leaders of PSOs in countries across the WHO regions and that operate in different settings (eg, as independent organization or within a university or government department) and conducted interviews with 15 senior managers from nine PSOs. Our findings provide in-depth insights about approaches and strategies across four stages for establishing a PSO, which include: (i) building awareness for the PSO; (ii) developing the PSO; (iii) assessing the PSO to identify potential areas for enhancement; and (iv) supporting maturation to build sustainability in the long-term. Our findings provide rich insights about the process of establishing a PSO from leaders who have undertaken the process.

CONCLUSION

While all PSOs share the same objective in supporting evidence-informed policy-making (EIPM), there is no single approach that can be considered to be the most successful in establishing a PSO, and each country should identify the approach based on its context.

Complexity and Evidence in Health Sector Decision Making: Lessons from Tuberculosis Infection Prevention in South Africa

To better understand and plan health systems featuring multiple levels and complex causal elements, there have been increasing attempts to incorporate tools arising from complexity science to inform decisions. The utilization of new planning approaches can have important implications for the types of evidence that inform health policymaking and the mechanisms through which they do so. This paper presents an empirical analysis of the application of one such tool—system dynamics modelling (SDM)—within a tuberculosis control programme in South Africa in order to explore how SDM was utilized, and to reflect on the implications for evidence-informed health policymaking. We observed group model building workshops that served to develop the SDM process and undertook 19 qualitative interviews with policymakers and practitioners who partook in these workshops. We analysed the relationship between the SDM process and the use of evidence for policymaking through four conceptual perspectives: (1) a rationalist knowledge-translation view that considers how previously-generated research can be taken up into policy; (2) a programmatic approach that considers existing goals and tasks of decision-makers, and how evidence might address them; (3) a social constructivist lens exploring how the process of using an evidentiary planning tool like SDM can shape the understanding of problems and their solutions; and (4) a normative perspective that recognizes that stakeholders may have different priorities, and thus considers which groups are included and represented in the process. Each perspective can provide useful insights into the SDM process and the political nature of evidence use. In particular, SDM can provide technical information to solve problems, potentially leave out other concerns and influence how problems are conceptualized by formalizing the boundaries of the policy problem and delineating particular solution sets. Undertaking the process further involves choices on stakeholder inclusion affecting whose interests may be served as evidence to inform decisions.

Mapping the Qualitative Evidence Base on the Use of Research Evidence in Health Policy-Making: A Systematic Review

BACKGROUND

The use of research evidence in health policy-making is a popular line of inquiry for scholars of public health and policy studies, with qualitative methods constituting the dominant strategy in this area. Research on this subject has been criticized for, among other things, disproportionately focusing on high-income countries; overemphasizing 'barriers and facilitators' related to evidence use to the neglect of other, less descriptive concerns; relying on descriptive, rather than in-depth explanatory designs; and failing to draw on insights from political/policy studies theories and concepts. We aimed to comprehensively map the global, peer-reviewed qualitative literature on the use of research evidence in health policy-making and to provide a descriptive overview of the geographic, temporal, methodological, and theoretical characteristics of this body of literature.

METHODS

We conducted a systematic review following PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. We searched nine electronic databases, hand-searched 11 health- and policy-related journals, and systematically scanned the reference lists of included studies and previous reviews. No language, date or geographic limitations were imposed.

RESULTS

The review identified 319 qualitative studies on a diverse array of topics related to the use of evidence in health policy-making, spanning 72 countries and published over a nearly 40 year period. A majority of these studies were conducted in high-income countries, but a growing proportion of the research output in this area is now coming from low- and middle-income countries, especially from sub-Saharan Africa. While over half of all studies did not use an identifiable theory or framework, and only one fifth of studies used a theory or conceptual framework drawn from policy studies or political science, we found some evidence that theory-driven and explanatory (eg, comparative case study) designs are becoming more common in this literature. Investigations of the barriers and facilitators related to evidence use constitute a large proportion but by no means a majority of the work in this area.

CONCLUSION

This review provides a bird's eye mapping of the peer reviewed qualitative research on evidence-to-policy processes, and has identified key features of - and gaps within - this body of literature that will hopefully inform, and improve, research in this area moving forward.

Open science at the science-policy interface: bringing in the evidence?

Part of the current enthusiasm about open science stems from its promises to reform scientific practice in service of the common good, to ensure that scientific outputs will be found and reused more easily, and to enhance scientific impact on policy and society. With this article, we question this optimism by analysing the potential for open science practices to enhance research uptake at the science–policy interface. Science advice is critical to help policy-makers make informed decisions. Likewise, some interpretations of open science hold that making research processes and outputs more transparent and accessible will also enhance the uptake of results by policy and society at large. However, we argue that this hope is based on an unjustifiably simplistic understanding of the science–policy interface that leaves key terms (“impact”, “uptake”) undefined. We show that this understanding—based upon linear models of research uptake—likewise grounds the influential “evidence–policy gap” diagnosis which holds that to improve research uptake, communication and interaction between researchers and policy-makers need to be improved. The overall normative stance of both discussions has sidelined empirical description of the science–policy interface, ignoring questions about the underlying differences between the policy domain and academia. Importantly, both open science and literature on closing the evidence–policy gap recommend improving communication (in terms of either the content or the means) as a viable strategy. To correct some of these views, we combine insights from policy theory with a narrative review of the literature on the evidence–policy gap in the health domain and find that removing barriers to access by itself will not be enough to foster research uptake.

Expert participation in 25 years of Wisconsin abortion policymaking

OBJECTIVE

State-level abortion restrictions grew considerably in number over the last two decades. This study examines the scope of expert testimony given in legislative committee hearings at which these laws are first debated.

STUDY DESIGN

We gathered 265 testimonies given by experts at Wisconsin legislative committee hearings on 34 abortion bills from 1995-2019. We coded testimonies to identify testifiers' ideological leaning and source of expertise. We conducted descriptive analyses of testifiers' participation.

RESULTS

Experts with anti-abortion rights views testified more often than experts with pro-abortion rights views (2.1 vs 1.4 testimonies per expert). Experts with an activism background testified more often than experts in medicine (2.5 vs 1.3 testimonies per expert). Anti-abortion activist experts represented the largest proportion of testimonies (32%) but the smallest proportion of testifiers (16%). Pro-abortion rights medical experts gave the fewest testimonies (24%) relative to their proportion of testifiers (31%). The number of testimonies given by pro-abortion rights activist experts remained stable over the study period. Testimonies given by all other kinds of experts were more numerous in recent years.

CONCLUSIONS

The experts who testify most frequently tend to espouse anti-abortion views and have backgrounds in activism rather than healthcare. These repeat testifiers may have more opportunities to build relationships with legislators and thus influence policy. Anti-abortion rights activist experts' outsized role in legislative hearings, especially in recent years, should concern advocates of evidence-based reproductive health policy. Medical experts may be deterred from giving testimony by logistical or other structural barriers in the legislative process.

IMPLICATIONS

The family planning field should conduct more research on the role of experts in abortion policymaking. Future studies should examine testifiers in other states and identify barriers pro-abortion medical experts may face to testifying, as these experts are key for creating evidence-based abortion policy.

Standard-relevant publications: evidence, processes and influencing factors

This paper introduces the concept of standard-relevant publications, complementary to standard-essential patents and framed by the concept of knowledge utilization. By analyzing the reference lists of the around 20,000 standards released by ISO, authors of scientific papers cited in standards who are working at German institutions were identified. The institutions include universities, independent research societies, ministerial research institutes and companies. Almost thirty interviews were conducted with the most-cited of these authors. The interviews addressed the processes by which scientific publications come to be referenced in standards, and the motivations, the barriers and the effects of this. The findings demonstrate opportunities for and challenges to establishing standard-relevant publications as a new performance indicator for researchers, funding agencies, standard-setting organizations and ultimately regulators.

Effectiveness of knowledge brokering and recommendation dissemination for influencing healthcare resource allocation decisions: A cluster randomised controlled implementation trial

BACKGROUND

Implementing evidence into clinical practice is a key focus of healthcare improvements to reduce unwarranted variation. Dissemination of evidence-based recommendations and knowledge brokering have emerged as potential strategies to achieve evidence implementation by influencing resource allocation decisions. The aim of this study was to determine the effectiveness of these two research implementation strategies to facilitate evidence-informed healthcare management decisions for the provision of inpatient weekend allied health services.

METHODS AND FINDINGS

This multicentre, single-blinded (data collection and analysis), three-group parallel cluster randomised controlled trial with concealed allocation was conducted in Australian and New Zealand hospitals between February 2018 and January 2020. Clustering and randomisation took place at the organisation level where weekend allied health staffing decisions were made (e.g., network of hospitals or single hospital). Hospital wards were nested within these decision-making structures. Three conditions were compared over a 12-month period: (1) usual practice waitlist control; (2) dissemination of written evidence-based practice recommendations; and (3) access to a webinar-based knowledge broker in addition to the recommendations. The primary outcome was the alignment of weekend allied health provision with practice recommendations at the cluster and ward levels, addressing the adoption, penetration, and fidelity to the recommendations. The secondary outcome was mean hospital length of stay at the ward level. Outcomes were collected at baseline and 12 months later. A total of 45 clusters (n = 833 wards) were randomised to either control (n = 15), recommendation (n = 16), or knowledge broker (n = 14) conditions. Four (9%) did not provide follow-up data, and no adverse events were recorded. No significant effect was found with either implementation strategy for the primary outcome at the cluster level (recommendation versus control β 18.11 [95% CI -8,721.81 to 8,758.02] p = 0.997; knowledge broker versus control β 1.24 [95% CI -6,992.60 to 6,995.07] p = 1.000; recommendation versus knowledge broker β -9.12 [95% CI -3,878.39 to 3,860.16] p = 0.996) or ward level (recommendation versus control β 0.01 [95% CI 0.74 to 0.75] p = 0.983; knowledge broker versus control β -0.12 [95% CI -0.54 to 0.30] p = 0.581; recommendation versus knowledge broker β -0.19 [-1.04 to 0.65] p = 0.651). There was no significant effect between strategies for the secondary outcome at ward level (recommendation versus control β 2.19 [95% CI -1.36 to 5.74] p = 0.219; knowledge broker versus control β -0.55 [95% CI -1.16 to 0.06] p = 0.075; recommendation versus knowledge broker β -3.75 [95% CI -8.33 to 0.82] p = 0.102). None of the control or knowledge broker clusters transitioned to partial or full alignment with the recommendations. Three (20%) of the clusters who only received the written recommendations transitioned from nonalignment to partial alignment. Limitations include underpowering at the cluster level sample due to the grouping of multiple geographically distinct hospitals to avoid contamination.

CONCLUSIONS

Owing to a lack of power at the cluster level, this trial was unable to identify a difference between the knowledge broker strategy and dissemination of recommendations compared with usual practice for the promotion of evidence-informed resource allocation to inpatient weekend allied health services. Future research is needed to determine the interactions between different implementation strategies and healthcare contexts when translating evidence into healthcare practice.

TRIAL REGISTRATION

Australian New Zealand Clinical Trials Registry ACTRN12618000029291.

How Research Evidence is Defined, Acquired, and Shared Across Systems That Address Intimate Partner Violence

This exploratory study examined the flow of research evidence through systems that address intimate partner violence (IPV), including victim services, law enforcement, and criminal justice organizations. Qualitative interviews with representatives of these disciplines assessed how respondents define, acquire, and share research evidence. Findings suggest that research evidence is defined more broadly in the field than in academic settings, and is accessed primarily from trusted intermediaries within professional networks. State IPV coalitions and victim service providers are key intermediaries across sectors. Findings suggest the need for more tangible supports to support sharing of research information within and across service sectors.

Leading the spread and adoption of innovation at scale: an Academic Health Science Network’s perspective

Background

There is virtually no limit to the number of innovations being developed, tested and piloted at any one time to improve the quality and safety of care. The perennial problem is spreading innovations that are proven to be effective on a smaller scale or under controlled conditions. Much of the literature on spread refers to the important role played by external agencies in supporting the spread of innovations.

Academic Health Science Networks and the spread of innovation

External agencies can provide additional capacity and capabilities to adopter organisations, such as technical expertise, resources and tools to assist with operational issues. In England, the National Health Service (NHS) established 15 Academic Health Science Networks (AHSNs) to help accelerate the spread and adoption of innovation in healthcare. However, formal clinical-academic networks (such as AHSNs) themselves will not deliver positive, tangible outcomes on the ground (ie, evidence-based innovations embedded at scale across a system). This begs the question of how do AHSNs practically go about achieving this change successfully? We provide an AHSN’s perspective on how we conceptualise and undertake our work in leading implementation of innovation at scale.

An AHSN's perspective

Our approach is a collaborative process of widening understanding of the innovation and its implementation. At its core, the implementation and spread of innovation into practice is a collective social process. Healthcare comprises complex adaptive systems, where contexts need to be negotiated for implementation to be successful. As AHSNs, we aim to lead this negotiation through facilitating knowledge exchange and production across the system to mobilise the resources and collective action necessary for achieving spread.

Ethics and Values in Design: A Structured Review and Theoretical Critique

A variety of approaches have appeared in academic literature and in design practice representing "ethics-first" methods. These approaches typically focus on clarifying the normative dimensions of design, or outlining strategies for explicitly incorporating values into design. While this body of literature has developed considerably over the last 20 years, two themes central to the endeavour of ethics and values in design (E + VID) have yet to be systematically discussed in relation to each other: (a) designer agency, and (b) the strength of normative claims informing the design process. To address this gap, we undertook a structured review of leading E + VID approaches and critiques, and classified them according to their positions on normative strength, and views regarding designer agency. We identified 18 distinct approaches and 13 critiques that met the inclusion criteria for our review. Included papers were distributed across the spectrum of views regarding normative strength, and we found that no approaches and only one critique represented a view characteristic of "low" designer agency. We suggest that the absence of "low" designer agency approaches results in the neglect of crucial influences on design as targets of intervention by designers. We conclude with suggestions for future research that might illuminate strategies to achieve ethical design in information mature societies, and argue that without attending to the tensions raised by balancing normatively "strong" visions of the future with limitations imposed on designer agency in corporate-driven design settings, "meaningful" ethical design will continue to encounter challenges in practice.

Lawmakers' use of scientific evidence can be improved

Core to the goal of scientific exploration is the opportunity to guide future decision-making. Yet, elected officials often miss opportunities to use science in their policymaking. This work reports on an experiment with the US Congress-evaluating the effects of a randomized, dual-population (i.e., researchers and congressional offices) outreach model for supporting legislative use of research evidence regarding child and family policy issues. In this experiment, we found that congressional offices randomized to the intervention reported greater value of research for understanding issues than the control group following implementation. More research use was also observed in legislation introduced by the intervention group. Further, we found that researchers randomized to the intervention advanced their own policy knowledge and engagement as well as reported benefits for their research following implementation.

Accelerating the conceptual use of behavioral health research in juvenile court decision-making: study protocol

BACKGROUND

The youth criminal-legal system is under heavy political scrutiny with multiple calls for significant transformation. Leaders within the system are faced with rethinking traditional models and are likely to benefit from behavioral health research evidence as they redesign systems. Little is known about how juvenile court systems access and use behavioral health research evidence; further, the field lacks a validated survey measure of behavioral health research use that can be used to evaluate the effectiveness of evidence dissemination interventions for policy and system leaders. Conceptual research use is a particularly salient construct for system reform as it describes the process of shifting awareness and the consideration of new frameworks for action. A tool designed to measure the conceptual use of behavioral health research would advance the field's ability to develop effective models of research evidence dissemination, including collaborative planning models to support the use of behavioral health research in reforms of the criminal-legal system.

METHODS

The ARC Study is a longitudinal, cohort and measurement validation study. It will proceed in two phases. The first phase will focus on measure development using established methods of construct validity (theoretical review, Delphi methods for expert review, cognitive interviewing). The second phase will involve gathering responses from the developed survey to examine scale psychometrics using Rasch analyses, change sensitivity analyses, and associations between research use exposure and conceptual research use among juvenile court leaders. We will recruit juvenile court leaders (judges, administrators, managers, supervisors) from 80 juvenile court jurisdictions with an anticipated sample size of n = 520 respondents.

DISCUSSION

The study will introduce a new measurement tool for the field that will advance implementation science methods for the study of behavioral health research evidence use in complex policy and decision-making interventions. To date, there are few validated survey measures of conceptual research use and no measures that are validated for measuring change in conceptual frameworks over time among agency leaders. While the study is most directly related to leaders in the youth criminal-legal system, the findings are expected to be informative for research focused on leadership and decision-making in diverse fields.

What makes a 'successful' collaborative research project between public health practitioners and academics? A mixed-methods review of funding applications submitted to a local intervention evaluation scheme

Background

The national Public Health Practice Evaluation Scheme (PHPES) is a response-mode funded evaluation programme operated by the National Institute for Health Research School for Public Health Research (NIHR SPHR). The scheme enables public health professionals to work in partnership with SPHR researchers to conduct rigorous evaluations of their interventions. Our evaluation reviewed the learning from the first five years of PHPES (2013–2017) and how this was used to implement a revised scheme within the School.

Methods

We conducted a rapid review of applications and reports from 81 PHPES projects and sampled eight projects (including unfunded) to interview one researcher and one practitioner involved in each sampled project (n = 16) in order to identify factors that influence success of applications and effective delivery and dissemination of evaluations. Findings from the review and interviews were tested in an online survey with practitioners (applicants), researchers (principal investigators [PIs]) and PHPES panel members (n = 19) to explore the relative importance of these factors. Findings from the survey were synthesised and discussed for implications at a national workshop with wider stakeholders, including public members (n = 20).

Results

Strengths: PHPES provides much needed resources for evaluation which often are not available locally, and produces useful evidence to understand where a programme is not delivering, which can be used to formatively develop interventions. Weaknesses: Objectives of PHPES were too narrowly focused on (cost-)effectiveness of interventions, while practitioners also valued implementation studies and process evaluations. Opportunities: PHPES provided opportunities for novel/promising but less developed ideas. More funded time to develop a protocol and ensure feasibility of the intervention prior to application could increase intervention delivery success rates. Threats: There can be tensions between researchers and practitioners, for example, on the need to show the 'success’ of the intervention, on the use of existing research evidence, and the importance of generalisability of findings and of generating peer-reviewed publications.

Conclusions

The success of collaborative research projects between public health practitioners (PHP) and researchers can be improved by funders being mindful of tensions related to (1) the scope of collaborations, (2) local versus national impact, and (3) increasing inequalities in access to funding. Our study and comparisons with related funding schemes demonstrate how these tensions can be successfully resolved.

Community engagement in public health: a bibliometric mapping of global research

Background

Community engagement (CE) has been regarded as a critical element of successful health programs to achieve “the health for all” goals. Numerous studies have shown that it plays a significant role in reducing inequalities, improving social justice, enhancing benefits, and sharing responsibility towards public health. Despite this, the extant literature of community engagement in public health (CEPH) has topic-focused boundaries and is scattered across disciplinary. Large-scale studies are needed to systematically identify current status, hotspots, knowledge structure, dynamic trends, and future developments in this field.

Methods

The bibliometric techniques were applied in the analysis of publications on CEPH in Web of Science Core Collection from Thomson Reuters. One thousand one hundred two papers out of 70.8 million publications over the period of 1980 to 2020 and their 15,116 references were retrieved as the sample set. First, basic characteristics of publications, including distributions of geography, journals and categories, productive authors and frequently cited articles, etc. were obtained. Then, four bibliometric methods, i.e. social network analysis, co-citation analysis, co-occurrence clustering, and burst detection, were further conducted to sketch the contours of the structure and evolution of CEPH.

Results

Between Jan 1, 1980, and Apr 25, 2020, CEPH has attracted a sharp increase in interest all over the world. Total 117 countries or regions have participated in the field of CEPH and the contributions are geographically and institutionally distinct. The United States is the key region performing such research, which accounts for more than half of the total number of publications. Developing countries, such as South Africa, India, Brazil and China also contributed a lot. The advancements of CEPH are marked by historically momentous public health events and evolved from macroscopic strategies to mesoscopic and microscopic actions. Based on keyword clustering and co-citation clustering, we propose a 4O (i.e. orientation, object, operation, and outcome) framework of CEPH to facilitate a better understanding of the current global achievements and an elaborate structuring of developments in the future.

Conclusion

This study draws an outline of the global review on the contemporary and cross-disciplinary research of CEPH which might present an opportunity to take stock and understand the march of knowledge as well as the logical venation underlying research activities which are fundamental to inform policy making.

The Experience of Colombian Medical Students in a Pilot Cultural Safety Training Program: A Qualitative Study Using the Most Significant Change Technique

Problem: The Colombian government provides health services grounded in the Western biomedical model, yet 40% of the population use cultural and traditional practices to maintain their health. Adversarial interactions between physicians and patients from other cultures hinder access to quality health services and reinforce health disparities. Cultural safety is an approach to medical training that encourages practitioners to examine how their own culture shapes their clinical practice and how to respect their patients' worldviews. This approach could help bridge the cultural divide in Colombian health services, improving multicultural access to health services and reducing health disparities. Intervention: In 2016, we conducted a pilot cultural safety training program in Cota, Colombia. A five-month training program for medical students included: (a) theoretical training on cultural safety and participatory research, and (b) a community-based intervention, co-designed by community leaders, training supervisors, and the medical students, with the aim of strengthening cultural practices related to health. Evaluation used the Most Significant Change narrative approach, which allows participants to communicate the changes most meaningful to them. Using an inductive thematic analysis, the authors analyzed the stories and discussed these findings in a debriefing session with the medical students. Context: Cota is located only 15 kilometers from Bogota, the national capital and biggest city of Colombia, so the small town has gone through rapid urbanization and cultural change. A few decades ago, inhabitants of Cota were mainly peasants with Indigenous and European traditions. Urbanization displaced agriculture with industrial and commercial occupations. One consequence of this change was loss of cultural health care practices and resources, for example, medicinal plants, that the community had used for centuries. Impact: A group of 13 final-year medical students (ten female and three male, age range 20-24) participated in the study. The medical students listed four areas of change after their experience: increased respect for traditional health practices to provide better healthcare; increased recognition of traditional practices as part of their cultural heritage and identity; a desire to deepen their knowledge about cultural practices; and openness to incorporate cultural practices in healthcare. Lessons Learned: Medical students reported positive perceptions of their patients' cultural practices after participating in this community-based training program. The training preceded a positive shift in perceptions and was accepted by Colombian medical students. To the best of our knowledge, this was the first documented cultural safety training initiative with medical students in Colombia and an early attempt to apply the cultural safety approach outside the Indigenous experience.

Aging, Dependence, and Long-Term Care: A Systematic Review of Employment Creation

Population aging is an economic and social challenge in most countries in the world as it generates higher dependency rates and increased demand for long-term care. Undertaking the care of older dependent adults can result in new opportunities for job creation. There is limited knowledge of the impact of dependent care and long-term care on employment. We examined this impact through a systematic review. Countries with conditional cash benefits show job creation, and countries with unconditional economic benefits reveal the development of a grey care market with high participation of migrant labor. Migrant employment in developed countries affects the development of the labor market in the countries of origin. The employment created to care for dependent persons is generally precarious. In conclusion, global aging will increase long-term care worker demand, but the variations in policies can determine what kind of employment is created.

How can we monitor the impact of national health information systems? Results from a scoping review

Background

National health information (HI) systems provide data on population health, the determinants of health and health system performance within countries. The evaluation of these systems has traditionally focused on statistical practices and procedures, and not on data use or reuse for policy and practice. This limits the capacity to assess the impact of HI systems on healthcare provision, management and policy-making. On the other hand, the field of Knowledge Translation (KT) has developed frameworks to guide evidence into practice.

Methods

A scoping review of the KT literature to identify the essential mechanisms and determinants of KT that could help monitor the impact of HI systems.

Results

We examined 79 publications and we identified over 100 different KT frameworks but none of these were focused on HI systems per se. There were specific recommendations on disseminating evidence to stakeholders at the institutional and organizational level, and on sustaining the use of evidence in practice and the broader community setting.

Conclusions

We developed a new model, the HI-Impact framework, in which four domains are essential for mapping the impact of national HI systems: (i) HI Evidence Quality, (ii) HI System Responsiveness, (iii) Stakeholder Engagement and (iv) Knowledge Integration. A comprehensive impact assessment of HI systems requires addressing the use of HI in public health decision-making, health service delivery and in other sectors which might have not been considered previously. Monitoring Stakeholder Engagement and Knowledge Integration certifies that the use of HI in all policies is an explicit point of assessment.

Powerful numbers: Exemplary quantitative studies of science that had policy impact

Much scientometric research aims to be relevant to policy, but such research only rarely has a notable policy impact. In this paper, we examine four exemplary cases of policy impact from quantitative studies of science. The cases are analyzed in light of lessons learned about the use of evidence in policy making in health services, which provides very thorough explorations of the problems inherent in policy use of academic research. The analysis highlights key dimensions of the examples, which offer lessons for those aspiring to influence policy with quantitative studies of science.

Codifying explicit and tacit practitioner knowledge in community social pediatrics organizations: Evaluation of the first step of a knowledge transfer strategy

In this article, we the present the evaluation of the first phase of a KT initiative, the codification of the tacit and explicit knowledge of community social pediatrics (CSP) practitioners. As increasing numbers of professionals began working in the CSP field, it became necessary to capture the know-how to make it better understood. This first phase of the initiative took advantage of one of the KM stages, the codifying process that is absent from KT models. The evaluation aim to answer the question: "What is the CSPs practitioners level of familiarity with the codification document, as well as their perceptions of its utility and its contribution to the understanding of the CSP model". The results, show that most respondents had consulted the codification document and were able to describe in detail parts of it. The results also show that they considered it to be a useful and necessary tool to guide practices and helpful in understanding the model. The results of this evaluation is paving the way for the next steps of the KT initiative.

Whistleblowing over patient safety and care quality: a review of the literature

PURPOSE

The purpose of this paper is to review existing research on whistleblowing in healthcare in order to develop an evidence base for policy and research.

DESIGN/METHODOLOGY/APPROACH

A narrative review, based on systematic literature protocols developed within the management field.

FINDINGS

The authors identify valuable insights on the factors that influence healthcare whistleblowing, and how organizations respond, but also substantial gaps in the coverage of the literature, which is overly focused on nursing, has been largely carried out in the UK and Australia, and concentrates on the earlier stages of the whistleblowing process.

RESEARCH LIMITATIONS/IMPLICATIONS

The review identifies gaps in the literature on whistleblowing in healthcare, but also draws attention to an unhelpful lack of connection with the much larger mainstream literature on whistleblowing.

PRACTICAL IMPLICATIONS

Despite the limitations to the existing literature important implications for practice can be identified, including enhancing employees' sense of security and providing ethics training.

ORIGINALITY/VALUE

This paper provides a platform for future research on whistleblowing in healthcare, at a time when policymakers are increasingly aware of its role in ensuring patient safety and care quality.

Exploring the evolution of engagement between academic public health researchers and decision-makers: from initiation to dissolution

CONTEXT

Relationships between researchers and decision-makers have demonstrated positive potential to influence research, policy and practice. Over time, interest in better understanding the relationships between the two parties has grown as demonstrated by a plethora of studies globally. However, what remains elusive is the evolution of these vital relationships and what can be learned from them with respect to advancing evidence-informed decision-making. We therefore explored the nuances around the initiation, maintenance and dissolution of academic-government relationships.

METHODS

We conducted in-depth interviews with 52 faculty at one school of public health and 24 government decision-makers at city, state, federal and global levels. Interviews were transcribed and coded deductively and inductively using Atlas.Ti. Responses across codes and respondents were extracted into an Excel matrix and compared in order to identify key themes.

FINDINGS

Eight key drivers to engagement were identified, namely (1) decision-maker research needs, (2) learning, (3) access to resources, (4) student opportunities, (5) capacity strengthening, (6) strategic positioning, (7) institutional conditionalities, and (8) funder conditionalities. There were several elements that enabled initiation of relationships, including the role of faculty members in the decision-making process, individual attributes and reputation, institutional reputation, social capital, and the role of funders. Maintenance of partnerships was dependent on factors such as synergistic collaboration (i.e. both benefit), mutual trust, contractual issues and funding. Dissolution of relationships resulted from champions changing/leaving positions, engagement in transactional relationships, or limited mutual trust and respect.

CONCLUSIONS

As universities and government agencies establish relationships and utilise opportunities to share ideas, envision change together, and leverage their collaborations to use evidence to inform decision-making, a new modus operandi becomes possible. Embracing the individual, institutional, networked and systems dynamics of relationships can lead to new practices, alternate approaches and transformative change. Government agencies, schools of public health and higher education institutions more broadly, should pay deliberate attention to identifying and managing the various drivers, enablers and disablers for relationship initiation and resilience in order to promote more evidence-informed decision-making.

Typologizing Stakeholder Information Use to Better Understand the Impacts of Collaborative Climate Science

There is increasing interest among scholars in producing information that is useful and usable to land and natural resource managers in a changing climate. This interest has prompted transitions from scientist- to stakeholder-driven or collaborative approaches to climate science. A common indicator of successful collaboration is whether stakeholders use the information resulting from the projects in which they are engaged. However, detailed examples of how stakeholders use climate information are relatively scarce in the literature, leading to a challenge in understanding what researchers can and should expect and plan for in terms of stakeholder use of research findings. Drawing on theoretical, typological, and evaluation insights from the field of information use, we examine stakeholder use of climate information emerging from 13 collaborative climate science projects conducted in the western United States between 2012 and 2016. Three primary types of use emerge from our findings-conceptual, instrumental, and justification-reflecting common typologization of information use. Conceptual use was the most predominant. We suggest that researcher awareness of this typology can enable more systematic understanding of what project outputs stakeholders use and impacts of those outputs, giving way to new areas of inquiry and aiding in the conceptualization and design of climate information products for land and natural resource managers.

Why Do Clinical Practice Guidelines Get Stuck during Implementation and What Can Be Done: A Case Study in Pediatric Rehabilitation

Aims: The purpose of this study was to obtain the perspectives of occupational and physical therapists working in pediatric rehabilitation about the factors that influence implementation of clinical practice guidelines (CPG) using the case of constraint induced movement therapy (CIMT). We aimed to identify factors that hinder implementation of CPGs and strategies for overcoming barriers when widespread implementation is stalled.Methods: Qualitative case study methodology was bounded within the parameters of CIMT implementation in pediatric rehabilitation in one jurisdiction. Twenty-one occupational and physical therapists participated in one of three focus groups. Data were analyzed using an inductive qualitative approach.Results: Participants viewed CPGs as useful, and emphasized the importance of consistency between guidelines and relevance to practice context. Therapists considered the "art and science" in clinical decision-making. Barriers and facilitators to CPG implementation were identified at the client, clinician, intervention location and systemic level. Potential solutions to help "unstick" guideline implementation were consistent with theories of collective knowledge exchange and mindlines.Conclusion: The presence of CPGs does not ensure evidence uptake; understanding of local barriers is required. This case study highlights the value of a collective knowledge exchange approach and attention to the social structures of knowledge development and evidence use.

"My good friends on the other side of the aisle aren't bothered by those facts": U.S. State legislators' use of evidence in making policy on abortion

OBJECTIVE

In recent years, U.S. states have passed many restrictive abortion policies with a rationale of protecting health and safety, in apparent contravention of abundant scientific evidence on abortion safety. This study explored whether and how state legislators use scientific evidence when deciding abortion policy.

STUDY DESIGN

We conducted 29 semi-structured interviews with state legislators and their aides in Maryland, North Carolina, and Virginia in March through July 2017. We recruited via e-mail to members of all health-related committees of the General Assembly in each state, plus sponsors and co-sponsors of 2017 abortion bills, with follow-up via phone and in person. We conducted iterative thematic analysis of all interview transcripts.

RESULTS

We found no cases of lawmakers' decisions on abortion being shifted by evidence. However, some lawmakers used evidence in simplified form to support their claims on abortion. Lawmakers gave credence to evidence they received from trusted sources, and that which supported their pre-existing policy preferences. Personal stories appeared more convincing than evidence, with participants drawing broad conclusions from anecdotes. Democrats and Republicans had different views on bias in evidence.

CONCLUSIONS

In this sample, evidence did not drive state legislators' policymaking on abortion. However, evidence did help inform high-level understanding of abortion, if such evidence supported legislators' pre-existing policy preferences. This work may help public health practitioners and researchers develop more realistic expectations for how research interacts with policymaking.

IMPLICATIONS OF THIS WORK

To increase the utility of research, reproductive health researchers and practitioners should 1) work with established intermediaries to convey findings to lawmakers; 2) present stories that illustrate research findings; and 3) consider the evidence needs of the judicial branch, in addition to those of legislators.

Structural approaches to knowledge exchange: comparing practices across five centres of excellence in public health

Background

In 2008, five UKCRC Public Health Research Centres of Excellence were created to develop a coordinated approach to policy and practice engagement and knowledge exchange. The five Centres have developed their own models and practices for achieving these aims, which have not been compared in detail to date.

Methods

We applied an extended version of Saner's model for the interface between science and policy to compare five case studies of knowledge exchanges, one from each centre. We compared these practices on three dimensions within our model (focus, function and type/scale) to identify barriers and facilitators for knowledge exchange.

Results

The case studies shared commonalities in their range of activities (type) but illustrated different ways of linking these activities (function). The Centres' approaches ranged from structural to more organic, and varied in the extent that they engaged internal audiences (focus). Each centre addressed policymakers at different geographical levels and scale.

Conclusions

This article emphasizes the importance of linking a range of activities that engage policymakers at different levels, intensities and points in their decision-making processes to build relationships. Developing a structural approach to knowledge exchange activities in different contexts presents challenges of resource, implementation and evaluation.

Organisational factors that facilitate research use in public health policy-making: a scoping review

Background

Although important syntheses and theoretical works exist in relation to understanding the organisational factors that facilitate research use, these contributions differ in their scope and object of study as well as their theoretical underpinnings. Therefore, from an exploratory angle, it may be useful to map out the current literature on organisational factors of research use in public health policy-making when revisiting existing theories and frameworks to gain further theoretical insights.

Methods

Herein, a scoping review technique and thematic content analysis were used to bring together findings from both synthesised and empirical studies of different types to map out the organisational factors that facilitate research use in public health policy-making.

Results

A total of 14 reviews and 40 empirical studies were included in the analysis. These were thematically coded and the intra-organisational factors reported as enabling research use were examined. Five main categories of organisational factors that advance research use in policy organisations – (1) individual factors, (2) the management of research integration, (3) organisational systems and infrastructures of research use, (4) institutional structures and rules for policy-making, and (5) organisational characteristics – were derived as well as 18 subcategories and a total of 64 specific factors, where 27 factors were well supported by research.

Conclusions

Using a scoping review methodology, the intra-organisational factors influencing research use in policy-making (including individual factors) were systematically mapped and the theories applied in this area of research were assessed. The review findings confirm the importance of an intra-organisational perspective when exploring research use, showing that many organisational factors are critical facilitators of research use but also that many factors and mechanisms are understudied. The synthesis shows a lack of studies on politicians and the need for more theoretically founded research. Despite increased efforts to update the existing evidential and theoretical basis of research use, we still need frameworks that combine different approaches and theories to help us grasp the complex organisational mechanisms that facilitate research use in policy settings.

Initiation is recognized as a fundamental early phase of integrated knowledge translation (IKT): qualitative interviews with researchers and research users in IKT partnerships

Background

Health care researcher-research user partnerships, referred to as integrated knowledge translation (IKT), have been adopted on an international basis, and are an effective means of co-generating and implementing evidence into policy and practice. Prior research suggests that an initiation period is essential for establishing functional partnerships. To characterize IKT initiation and describe determinants of IKT initiation success, this study explored IKT initiation processes, enablers, and barriers among researchers and research users involved in IKT partnerships.

Methods

A descriptive qualitative approach was used compliant with COREQ standards. Canadian researchers and research users in research collaborations were identified on publicly-available directories and web sites, and referred by those interviewed. They were asked to describe how partnerships were initiated, influencing factors, the length of initiation, and interventions needed to support initiation. Sampling was concurrent with data collection and analysis to achieve thematic saturation. Data were analyzed using constant comparative technique by all members of the research team.

Results

In total, 22 individuals from 6 provinces were interviewed (9 researchers, 11 research users, 2 connectors). They confirmed that IKT initiation is a distinct early phase of partnerships. The period ranged from 6 months to 2 years for 75.0% of participants in pre-existing partnerships, to 6 years for newly-formed partnerships. High-level themes were: Newly identifying and securing partners is an intensive process; Processes and activities take place over a protracted period through multiple interactions; Identifying and engaging committed partners is reliant on funding; and Partnership building is challenged by maintaining continuity and enthusiasm. Participants underscored the need for an IKT partner matching forum, IKT initiation toolkit, and funding for non-research activities required during IKT initiation to establish functional researcher-research user partnerships. Themes were largely similar regardless of participant years of experience with IKT or being involved in a new versus pre-existing partnership.

Conclusions

IKT initiation is a recognized and important early phase of IKT that establishes functional partnerships, and once established, ongoing partnership for subsequent projects is likely. Further research is needed to develop and evaluate approaches recommended by participants for stimulating IKT initiation.

French cross-cultural adaptation of the Organizational Readiness for Implementing Change (ORIC)

BACKGROUND

Organizational readiness is a factor known to influence the predisposition of individuals within an organization to change. Based on Weiner's organizational theory, the "Organizational Readiness for Implementing Change" (ORIC) questionnaire was developed and validated to measure organizational readiness in healthcare contexts. However, no such tools allow French-speaking organizations to measure this concept. The objectives of this study were to (1) conduct a French cultural adaptation of the ORIC questionnaire, and (2) initiate the study of its psychometric properties.

METHODS

(1) Cross-cultural adaptation and translation processes were first conducted with the methodologies of Beaton, Vallerand and Massoubre. (2) Subsequently, internal consistency was documented by calculating Cronbach's alpha and inter-item and item-to-scale correlations. The study of construct validity was initiated with a confirmatory factor analysis.

RESULTS

A French 10-item scale named the Réceptivité organisationnelle à l'implantation d'un changement (ROIC) was developed and pretested by 125 occupational therapists working in Quebec homecare services. Cronbach's alpha values for the 2 item subscales show satisfactory internal consistency (Commitment: α = 0.84 and Efficacy: α = 0.86). Inter-item correlations revealed that the ROIC's items are moderately related to each other while item-to-total scale correlations pinpoint items that accounts for variance and influence internal consistency. Confirmatory factor analysis allowed the initiation of a substantial documentation of ROIC's model fit with the original version (CFI = 0.89, TLI = 0.85, SRMR = 0.08, and RMSEA = 0.12).

CONCLUSIONS

The ROIC is a new theory-based and translated questionnaire that can be used to rigorously document the organizational readiness of French organizations. The ROIC has the potential to support members of different organizations in the identification of subsequent efforts for the implementation of a change.

Turning conceptual systems maps into dynamic simulation models: An Australian case study for diabetes in pregnancy

BACKGROUND

System science approaches are increasingly used to explore complex public health problems. Quantitative methods, such as participatory dynamic simulation modelling, can mobilise knowledge to inform health policy decisions. However, the analytic and practical steps required to turn collaboratively developed, qualitative system maps into rigorous and policy-relevant quantified dynamic simulation models are not well described. This paper reports on the processes, interactions and decisions that occurred at the interface between modellers and end-user participants in an applied health sector case study focusing on diabetes in pregnancy.

METHODS

An analysis was conducted using qualitative data from a participatory dynamic simulation modelling case study in an Australian health policy setting. Recordings of participatory model development workshops and subsequent meetings were analysed and triangulated with field notes and other written records of discussions and decisions. Case study vignettes were collated to illustrate the deliberations and decisions made throughout the model development process.

RESULTS

The key analytic objectives and decision-making processes included: defining the model scope; analysing and refining the model structure to maximise local relevance and utility; reviewing and incorporating evidence to inform model parameters and assumptions; focusing the model on priority policy questions; communicating results and applying the models to policy processes. These stages did not occur sequentially; the model development was cyclical and iterative with decisions being re-visited and refined throughout the process. Storytelling was an effective strategy to both communicate and resolve concerns about the model logic and structure, and to communicate the outputs of the model to a broader audience.

CONCLUSION

The in-depth analysis reported here examined the application of participatory modelling methods to move beyond qualitative conceptual mapping to the development of a rigorously quantified and policy relevant, complex dynamic simulation model. The analytic objectives and decision-making themes identified provide guidance for interpreting, understanding and reporting future participatory modelling projects and methods.

The Role of Integrated Knowledge Translation in Intervention Research

There is widespread recognition across the full range of applied research disciplines, including health and social services, about the challenges of integrating scientifically derived research evidence into policy and/or practice decisions. These "disconnects" or "knowledge-practice gaps" between research production and use have spawned a new research field, most commonly known as either "implementation science" or "knowledge translation." The present paper will review key concepts in this area, with a particular focus on "integrated knowledge translation" (IKT)-which focuses on researcher-knowledge user partnership-in the area of mental health and prevention of violence against women and children using case examples from completed and ongoing work. A key distinction is made between the practice of KT (disseminating, communicating, etc.), and the science of KT, i.e., research regarding effective KT approaches. We conclude with a discussion of the relevance of IKT for mental health intervention research with children and adolescents.

Overview of a Knowledge Translation (KT) Project to improve the vaccination experience at school: The CARD™ System

Background

Students experience fear, pain, and fainting during vaccinations at school. While evidence-based interventions exist, no Knowledge Translation (KT) interventions have been developed to mitigate these symptoms. A multidisciplinary team—the Pain Pain Go Away Team—was assembled to address this knowledge-to-care gap. This manuscript provides an overview of the methodology, knowledge products, and impact of an evidence-based KT program developed and implemented to improve the vaccination experience at school.

Methods

We adapted knowledge and assessed the barriers to knowledge use via focus group interviews with key stakeholder groups involved in school-based vaccinations: students, nurses, school staff, and parents. Next, we developed project-specific goals and data collection tools and collected baseline data. We then created a multifaceted KT intervention called The CARD™ System (C-Comfort, A-Ask, R-Relax, D-Distract) to provide a framework for planning and delivering vaccinations using a student-centred approach. Selected KT tools from this framework were reviewed in additional focus groups held in all stakeholder groups. The multifaceted KT intervention was then finalized and implemented in stages in two projects including grade 7 students undergoing school vaccinations and impact on student outcomes (e.g., symptoms of fear, pain, dizziness) and process outcomes (e.g., utilization of interventions that reduce student symptoms, vaccination rate) were assessed.

Results

Participants reported that improving the vaccination experience is important. Based on participant feedback, an evidence-based multifaceted KT intervention called The CARD™ System was developed that addresses user needs and preferences. Selected KT tools of this intervention were demonstrated to be acceptable and to improve knowledge and attitudes about vaccination in the stakeholder groups. In two separate implementation projects, CARD™ helped grade 7 students prepare for vaccinations and positively impacted on their vaccination experiences. CARD™ improved vaccination experiences for other stakeholder groups as well. There was no evidence of an impact on school vaccination rates.

Conclusion

We developed and implemented a promising multifaceted KT intervention called The CARD™ System to address vaccination-associated pain, fear, and fainting. Future research is recommended to determine impact in students of different ages and in different geographical regions and clinical contexts.

Deimplementing Untested Practices in Homecare Services: A Preobservational-Postobservational Design

INTRODUCTION

With community-dwelling elders waiting to adapt their bathroom, Health and Social Services Centers in Quebec (Canada) combined human resources through cross-skilling within interdisciplinary teams. To this end, occupational therapists implemented in-house "tools" to support nonoccupational therapists in selecting bathing equipment. However, unknown psychometric properties of those in-house "tools" cast doubt on the quality of service provided to elders. Little is also known about the best processes to use to support the deimplementation of such nonevidence-based practices. This study presents the effect of a knowledge transfer and exchange intervention designed to deimplement in-house "tools" and replace them with an evidence-based tool (Algo).

METHODS

Censuses were conducted with the 94 Health and Social Services Centers of Quebec providing homecare services, before and after the knowledge transfer and exchange intervention (2009-2013). In 2013, the deimplementation of in-house "tools" and their replacement by Algo were measured with Knott and Wildavsky's levels of utilization.

RESULTS

Cross-skilling within interdisciplinary teams increased between censuses (87% to 98%), as did use of in-house "tools" (67% to 81%). Algo's uptake started during the knowledge transfer and exchange process as 25 Health and Social Services Centers achieved the first level of utilization. Nonetheless, no Health and Social Services Center deimplemented the in-house "tools" to use Algo.

CONCLUSION

The knowledge transfer and exchange process led to the development of a scientifically sound clinical tool (Algo) and challenged the status quo in clinical settings regarding the use of nonevidence-based practices. However, the deimplementation of in-use practices has not yet been observed. This study highlights the need to act proactively on the deimplementation and implementation processes.