Use of health systems and policy research evidence in the health policymaking in eastern Mediterranean countries: views and practices of researchers

Knowledge-Based Query Construction Using the CDSS Knowledge Base for Efficient Evidence Retrieval

Finding appropriate evidence to support clinical practices is always challenging, and the construction of a query to retrieve such evidence is a fundamental step. Typically, evidence is found using manual or semi-automatic methods, which are time-consuming and sometimes make it difficult to construct knowledge-based complex queries. To overcome the difficulty in constructing knowledge-based complex queries, we utilized the knowledge base (KB) of the clinical decision support system (CDSS), which has the potential to provide sufficient contextual information. To automatically construct knowledge-based complex queries, we designed methods to parse rule structure in KB of CDSS in order to determine an executable path and extract the terms by parsing the control structures and logic connectives used in the logic. The automatically constructed knowledge-based complex queries were executed on the PubMed search service to evaluate the results on the reduction of retrieved citations with high relevance. The average number of citations was reduced from 56,249 citations to 330 citations with the knowledge-based query construction approach, and relevance increased from 1 term to 6 terms on average. The ability to automatically retrieve relevant evidence maximizes efficiency for clinicians in terms of time, based on feedback collected from clinicians. This approach is generally useful in evidence-based medicine, especially in ambient assisted living environments where automation is highly important.

Health Reporting in Print Media in Lebanon: Evidence, Quality and Role in Informing Policymaking

Background

Media plays a vital role in shaping public policies and opinions through disseminating health-related information. This study aims at exploring the role of media in informing health policies in Lebanon, identifying the factors influencing health reporting and investigating the role of evidence in health journalism and the quality of health reporting. It also identifies strategies to enhance the use of evidence in health journalism and improve the quality of health reporting.

Methods

Media analysis was conducted to assess the way media reports on health-related issues and the quality of reporting using a quality assessment tool. Semi-structured interviews were also conducted with 27 journalists, researchers and policymakers to explore their perception on the role of media in health policymaking and the factors influencing health reporting. In addition, a validation workshop was conducted.

Results

Out of 1,279 health-related news articles identified, 318 articles used certain type of evidence to report health issues 39.8% of which relied on experts’ opinions as their source of evidence while only 5.9% referenced peer-reviewed research studies. The quality of health reporting was judged to be low based on a quality assessment tool consisting of a set of ten criteria. Journalists raised concerns about issues impeding them from referring to evidence. Journalists also reported difficulties with the investigative health journalism. Policymakers and researchers viewed media as an important tool for evidence-informed health policies, however, serious concerns were voiced in terms of the current practice and capacities.

Conclusion

Our study provides a structured reflection on the role of media and the factors that influence health reporting including context-specific strategies that would enhance the quality and promote the use of evidence in health reporting. In the light of the political changes in many Middle Eastern countries, findings from this study can contribute to redefining the role of media in strengthening health systems.

Using conjoint analysis to develop a system of scoring policymakers' use of research in policy and program development

Background

The importance of utilising the best available research evidence in the development of health policies, services, and programs is increasingly recognised, yet few standardised systems for quantifying policymakers’ research use are available. We developed a comprehensive measurement and scoring tool that assesses four domains of research use (i.e. instrumental, conceptual, tactical, and imposed). The scoring tool breaks down each domain into its key subactions like a checklist. Our aim was to develop a tool that assigned appropriate scores to each subaction based on its relative importance to undertaking evidence-informed health policymaking. In order to establish the relative importance of each research use subaction and generate this scoring system, we conducted conjoint analysis with a sample of knowledge translation experts.

Methods

Fifty-four experts were recruited to undertake four choice surveys. Respondents were shown combinations of research use subactions called profiles, and rated on a 1 to 9 scale whether each profile represented a limited (1–3), moderate (4–6), or extensive (7–9) example of research use. Generalised Estimating Equations were used to analyse respondents’ choice data, which calculated a utility coefficient for each subaction. A large utility coefficient indicated that a subaction was particularly influential in guiding experts’ ratings of extensive research use.

Results

Utility coefficients were calculated for each subaction, which became the points assigned to the subactions in the scoring system. The following subactions yielded the largest utilities and were regarded as the most important components of each research use domain: using research to directly influence the core of the policy decision; using research to inform alternative perspectives to deal with the policy issue; using research to persuade targeted stakeholders to support a predetermined decision; and using research because it was a mandated requirement by the policymaker’s organisation.

Conclusions

We have generated an empirically derived and context-sensitive means of measuring and scoring the extent to which policymakers used research to inform the development of a policy document. The scoring system can be used by organisations to not only quantify the extent of their research use, but also to provide them with insights into potential strategies to improve subsequent research use.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-015-0022-y) contains supplementary material, which is available to authorized users.

Survey of Argentine health researchers on the use of evidence in policymaking

OBJECTIVE

In this study, Argentine health researchers were surveyed regarding their perceptions of facilitators and barriers to evidence-based policymaking in Argentina, as well as their publication activities, and research environment satisfaction.

METHODS

A self-administered online survey was sent to health researchers in Argentina. The survey questions were based on a preceding qualitative study of Argentine health researchers, as well as the scientific literature.

RESULTS

Of the 647 researchers that were reached, 226 accessed the survey, for a response rate of 34.9%. Over 80% of researchers surveyed had never been involved in or contributed to decision-making, while over 90% of researchers indicated they would like to be involved in the decision-making process. Decision-maker self-interest was perceived to be the driving factor in the development of health and healthcare policies. Research conducted by a research leader was seen to be the most influential factor in influencing health policy, followed by policy relevance of the research. With respect to their occupational environment, researchers rated highest and most favourably the opportunities available to present, discuss and publish research results and their ability to further their education and training. Argentine researchers surveyed demonstrated a strong interest and willingness to contribute their work and expertise to inform Argentine health policy development.

CONCLUSION

Despite Argentina's long scientific tradition, there are relatively few institutionalized linkages between health research results and health policymaking. Based on the results of this study, the disconnect between political decision-making and the health research system, coupled with fewer opportunities for formalized or informal researcher/decision-maker interaction, contribute to the challenges in evidence informing health policymaking in Argentina. Improving personal contact and the building of relationships between researchers and policymakers in Argentina will require taking into account researcher perceptions of policymakers, as highlighted in this study.

Using conjoint analysis to develop a system to score research engagement actions by health decision makers

Background

Effective use of research to inform policymaking can be strengthened by policymakers undertaking various research engagement actions (e.g., accessing, appraising, and applying research). Consequently, we developed a thorough measurement and scoring tool to assess whether and how policymakers undertook research engagement actions in the development of a policy document. This scoring tool breaks down each research engagement action into its key ‘subactions’ like a checklist. The primary aim was to develop the scoring tool further so that it assigned appropriate scores to each subaction based on its effectiveness for achieving evidence-informed policymaking. To establish the relative effectiveness of these subactions, we conducted a conjoint analysis, which was used to elicit the opinions and preferences of knowledge translation experts.

Method

Fifty-four knowledge translation experts were recruited to undertake six choice surveys. Respondents were exposed to combinations of research engagement subactions called ‘profiles’, and rated on a 1–9 scale whether each profile represented a limited (1–3), moderate (4–6), or extensive (7–9) example of each research engagement action. Generalised estimating equations were used to analyse respondents’ choice data, where a utility coefficient was calculated for each subaction. A large utility coefficient indicates that a subaction was influential in guiding experts’ ratings of extensive engagement with research.

Results

The calculated utilities were used as the points assigned to the subactions in the scoring system. The following subactions yielded the largest utilities and were regarded as the most important components of engaging with research: searching academic literature databases, obtaining systematic reviews and peer-reviewed research, appraising relevance by verifying its applicability to the policy context, appraising quality by evaluating the validity of the method and conclusions, engaging in thorough collaborations with researchers, and undertaking formal research projects to inform the policy in question.

Conclusions

We have generated an empirically-derived and context-sensitive method of measuring and scoring the extent to which policymakers engaged with research to inform policy development. The scoring system can be used by organisations to quantify staff research engagement actions and thus provide them with insights into what types of training, systems, and tools might improve their staff’s research use capacity.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-015-0013-z) contains supplementary material, which is available to authorized users.

Usage of an online tool to help policymakers better engage with research: Web CIPHER

BACKGROUND

There is a need to develop innovations that help policymakers better engage with research in order to increase its use in policymaking. As part of the Centre for Informing Policy in Health with Evidence from Research (CIPHER), we established Web CIPHER, an online tool with dynamic interactive elements such as hot topics, research summaries, blogs from trusted figures in health policy and research, a community bulletin board, multimedia section and research portal. The aim of this study was to examine policymakers' use of the website, and determine which sections were key drivers of use.

METHODS

Google Analytics (GA) was used to gather usage data during a 16-month period. Analysis was restricted to Web CIPHER members from policy agencies. We examined descriptive statistics including mean viewing times, number of page visits and bounce rates for each section and performed analyses of variance to compare usage between sections. Repeated measures analyses were undertaken to examine whether a weekly reminder email improved usage of Web CIPHER, particularly for research-related content.

RESULTS

During the measurement period, 223 policymakers from more than 32 organisations joined Web CIPHER. Users viewed eight posts on average per visit and stayed on the site for approximately 4 min. The bounce rate was less than 6%. The Blogs and Community sections received more unique views than all other sections. Blogs relating to improving policymakers' skills in applying research to policy were particularly popular. The email reminder had a positive effect on improving usage, particularly for research-related posts.

CONCLUSIONS

The data indicated a relatively small number of users. However, this sample may not be representative of policymakers since membership to the site and usage was completely voluntarily. Nonetheless, those who used the site appeared to engage well with it. The findings suggest that providing blog-type content written by trusted experts in health policy and research as well as regular email reminders may provide an effective means of disseminating the latest research to policymakers through an online web portal.

Health systems and policy research evidence in health policy making in Israel: what are researchers' practices in transferring knowledge to policy makers?

Background

Ensuring the use of research evidence in health system management and policy decisions is an important challenge in this century. Knowledge transfer and exchange (KTE) has emerged as a paradigm to address the challenges and start closing the ‘know-do’ gap. This area of work is gaining momentum in most developed countries, yet, to date, no work has been performed in Israel within this area. The purpose of this study was to identify which KTE activities health systems and policy researchers in Israel have undertaken.

Methods

A cross-sectional web-based survey of researchers who have conducted health systems and policy research in Israel was developed. The survey consisted of a demographics section, quantitative scales, and open-ended questions. The survey was sent to all health systems and policy researchers in Israel (n = 125).

Results

The study response rate (28%) was relatively low as compared to other studies in the same field (range of 42% to 88%). Our survey found that more than a third of the health systems and policy researchers in Israel reported that they were frequently or always involved in the following KTE activities: interactions with target audience through the research process (i.e., during developing a research question or executing the research; 35% to 42%) or through formal or informal meetings during conferences, workshops, or conversations (40%). Less than half of the health systems and policy researchers in Israel are engaged in bridging activities aimed to facilitate target audiences to use research.

Conclusions

This is a fairly new area in Israel and therefore the level of engagement of researchers in KTE activities is not very high. The low response rates could be because KTE is a new field in Israel and minimal KTE initiatives have been undertaken. It is preferable to have higher response rates, yet, after several initiatives, this was the outcome. While the findings are relevant, they may not reflect the total population of health system and policy researchers in Israel. Health system and policy researchers in Israel need to be introduced to the benefits and potential advantages of KTE in an organized and systematic way.

Constraints to applying systems thinking concepts in health systems: A regional perspective from surveying stakeholders in Eastern Mediterranean countries

BACKGROUND

Systems Thinking (ST) has recently been promoted as an important approach to health systems strengthening. However, ST is not common practice, particularly in Low- and Middle-Income Countries (LMICs). This paper seeks to explore the barriers that may hinder its application in the Eastern Mediterranean Region (EMR) and possible strategies to mitigate them.

METHODS

A survey consisting of open-ended questions was conducted with a purposive sample of health policy-makers such as senior officials from the Ministry of Health (MoH), researchers, and other stakeholders such as civil society groups and professional associations from ten countries in the region. A total of 62 respondents participated in the study. Thematic analysis was conducted.

RESULTS

There was strong recognition of the relevance and usefulness of ST to health systems policy-making and research, although misconceptions about what ST means were also identified. Experience with applying ST was very limited. Approaches to designing health policies in the EMR were perceived as reactive and fragmented (66%). Commonly perceived constraints to application of ST were: a perceived notion of its costliness combined with lack of the necessary funding to operationalize it (53%), competing political interests and lack of government accountability (50%), lack of awareness about relevance and value (47%), limited capacity to apply it (45%), and difficulty in coordinating and managing stakeholders (39%).

CONCLUSION

While several strategies have been proposed to mitigate most of these constraints, they emphasized the importance of political endorsement and adoption of ST at the leadership level, together with building the necessary capacity to apply it and apply the learning in research and practice.

Feasibility of a rapid response mechanism to meet policymakers' urgent needs for research evidence about health systems in a low income country: a case study

OBJECTIVES

Despite the recognition of the importance of evidence-informed health policy and practice, there are still barriers to translating research findings into policy and practice. The present study aimed to establish the feasibility of a rapid response mechanism, a knowledge translation strategy designed to meet policymakers' urgent needs for evidence about health systems in a low income country, Uganda. Rapid response mechanisms aim to address the barriers of timeliness and relevance of evidence at the time it is needed.

METHODS

A rapid response mechanism (service) designed a priori was offered to policymakers in the health sector in Uganda. In the form of a case study, data were collected about the profile of users of the service, the kinds of requests for evidence, changes in answers, and courses of action influenced by the mechanism and their satisfaction with responses and the mechanism in general.

RESULTS

We found that in the first 28 months, the service received 65 requests for evidence from 30 policymakers and stakeholders, the majority of whom were from the Ministry of Health. The most common requests for evidence were about governance and organization of health systems. It was noted that regular contact between the policymakers and the researchers at the response service was an important factor in response to, and uptake of the service. The service seemed to increase confidence for policymakers involved in the policymaking process.

CONCLUSION

Rapid response mechanisms designed to meet policymakers' urgent needs for research evidence about health systems are feasible and acceptable to policymakers in low income countries.

The knowledge translation status in selected Eastern-Mediterranean universities and research institutes

Background

A serious worldwide effort to strengthen research based knowledge translation (KT) has begun in recent years and some countries, particularly developed ones, are trying to incorporate KT in their health and health research systems. Keeping in mind the recent economic depression and the need to perform more efficient research, we aimed to assess and compare the KT status of selected health research institutes in the Eastern Mediterranean Regions' countries, and to identify their strengths and weaknesses in the field.

Methods

After finding the focal points that would steer the focus group discussions (FGDs) and help complete the ‘Self Assessment Tool for Research Institutes’ (SATORI) tool, each focal point held two FGDs in which researchers, research authorities and other individuals specified in detail further in the study were held. The scores obtained by each institute were evaluated quantitatively, and the transcriptions were analyzed qualitatively with OpenCode software.

Results

For ease of analysis the 50 items of the SATORI were classified into 7 main domains: ‘priority setting’, ‘research quality and timeliness’, ‘researchers’ KT capacities', ‘facilities and pre-requisites of KT’, ‘processes and regulations supporting KT’, ‘interaction with research users’, and ‘promoting and evaluating the use of knowledge’. Based on the scoring system, the strongest domain was ‘research quality and timeliness’. ‘Priority setting’ was the weakest domain of all. The remaining domains were more or less equal in strength and were not in a favorable state. The qualitative findings confirmed the quantitative findings.

Conclusions

The main problem, it seems, is that a KT climate does not exist in the region. And despite the difference in the contexts, there are many similarities in the region's institutes included in this study. Collaborative efforts can play a role in creating this climate by steering countries towards KT and suggesting regional strategic directions according to their needs.

The making of nursing practice law in Lebanon: a policy analysis case study

BACKGROUND

Evidence-informed decisions can strengthen health systems, improve health, and reduce health inequities. Despite the Beijing, Montreux, and Bamako calls for action, literature shows that research evidence is underemployed in policymaking, especially in the East Mediterranean region (EMR). Selecting the draft nursing practice law as a case study, this policy analysis exercise aims at generating in-depth insights on the public policymaking process, identifying the factors that influence policymaking and assessing to what extent evidence is used in this process.

METHODS

This study utilized a qualitative research design using a case study approach and was conducted in two phases: data collection and analysis, and validation. In the first phase, data was collected through key informant interviews that covered 17 stakeholders. In the second phase, a panel discussion was organized to validate the findings, identify any gaps, and gain insights and feedback of the panelists. Thematic analysis was conducted and guided by the Walt & Gilson's "Policy Triangle Framework" as themes were categorized into content, actors, process, and context.

RESULTS

Findings shed light on the complex nature of health policymaking and the unstructured approach of decision making. This study uncovered the barriers that hindered the progress of the draft nursing law and the main barriers against the use of evidence in policymaking. Findings also uncovered the risk involved in the use of international recommendations without the involvement of stakeholders and without accounting for contextual factors and implementation barriers. Findings were interpreted within the context of the Lebanese political environment and the power play between stakeholders, taking into account equity considerations.

CONCLUSIONS

This policy analysis exercise presents findings that are helpful for policymakers and all other stakeholders and can feed into revising the draft nursing law to reach an effective alternative that is feasible in Lebanon. Our findings are relevant in local and regional context as policymakers and other stakeholders can benefit from this experience when drafting laws and at the global context, as international organizations can consider this case study when developing global guidance and recommendations.

Research capacity and training needs for non-communicable diseases in the public health arena in Turkey

Background

The aim of this study is to define the research capacity and training needs for professionals working on non-communicable diseases (NCDs) in the public health arena in Turkey.

Methods

This study was part of a comparative cross-national research capacity-building project taking place across Turkey and the Mediterranean Middle East (RESCAP-Med, funded by the EU). Identification of research capacity and training needs took place in three stages. The first stage involved mapping health institutions engaged in NCD research, based on a comprehensive literature review. The second stage entailed in-depth interviews with key informants (KIs) with an overview of research capacity in public health and the training needs of their staff. The third stage required interviewing junior researchers, identified by KIs in stage two, to evaluate their perceptions of their own training needs. The approach we have taken was based upon a method devised by Hennessy&Hicks. In total, 55 junior researchers identified by 10 KIs were invited to participate, of whom 46 researchers agreed to take part (84%). The specific disciplines in public health identified in advance by RESCAP-MED for training were: advanced epidemiology, health economics, environmental health, medical sociology-anthropology, and health policy.

Results

The initial literature review showed considerable research on NCDs, but concentrated in a few areas of NCD research. The main problems listed by KIs were inadequate opportunities for specialization due to heavy teaching workloads, the lack of incentives to pursue research, a lack of financial resources even when interest existed, and insufficient institutional mechanisms for dialogue between policy makers and researchers over national research priorities. Among junior researchers, there was widespread competence in basic epidemiological skills, but an awareness of gaps in knowledge of more advanced epidemiological skills, and the opportunities to acquire these skills were lacking. Self-assessed competencies in each of the four other disciplines considered revealed greater training needs, especially regarding familiarity with the qualitative research skills for medical anthropology/sociology.

Conclusions

In Turkey there are considerable strengths to build upon. But a combination of institutional disincentives for research, and the lack of opportunities for the rising generation of researchers to acquire advanced training skills.

Research's Practice and Barriers of Knowledge Translation in Iran

BACKGROUND

Knowledge Translation is a process that includes synthesis, dissemination, exchange and application of knowledge to improve the health, services and products In this study we have attempted to examine the knowledge translation practice and its perceived barriers on the universalities and research institutes (research sector) in Iran.

METHODS

Both qualitative and quantitative approaches were used. In the quantitative section, a questionnaire had prepared for this study was completed by 88 authors country wide from randomly selected papers. In the qualitative section 13 in-depth interviews and 6 focus group discussions were held with managers and policy makers, clinical and health service providers, and researchers.

RESULTS

Twenty four percent of the authors had no interaction whatsoever with the target audience. Lack of expectation toward creating change in the target audience, researchers' incentives, low level of trust among researchers and decision makers, absence of a predefined mechanism for delivery of research results and inappropriate research priorities were among the most important barriers identified in the qualitative section.

CONCLUSION

Translation of research findings into some concrete outputs which can affect health of people is not in mandate of researchers and subsequently they are not prepared for this as well. Based on the barriers identified, it seems that the following interventions are necessary: cooperation among policy makers at macro and meso (organizational) level and the research sector; establishing networks for researchers and decision makers in choosing the research topic, priority setting, and building trust among researchers and policy makers.

Capturing lessons learned from evidence-to-policy initiatives through structured reflection

Background

Knowledge translation platforms (KTPs), which are partnerships between policymakers, stakeholders, and researchers, are being established in low- and middle-income countries (LMICs) to enhance evidence-informed health policymaking (EIHP). This study aims to gain a better understanding of the i) activities conducted by KTPs, ii) the way in which KTP leaders, policymakers, and stakeholders perceive these activities and their outputs, iii) facilitators that support KTP work and challenges, and the lessons learned for overcoming such challenges, and iv) factors that can help to ensure the sustainability of KTPs.

Methods

This paper triangulated qualitative data from: i) 17 semi-structured interviews with 47 key informants including KTP leaders, policymakers, and stakeholders from 10 KTPs; ii) document reviews, and iii) observation of deliberations at the International Forum on EIHP in LMICs held in Addis Ababa in August 2012. Purposive sampling was used and data were analyzed using thematic analysis.

Results

Deliberative dialogues informed by evidence briefs were identified as the most commendable tools by interviewees for enhancing EIHP. KTPs reported that they have contributed to increased awareness of the importance of EIHP and strengthened relationships among policymakers, stakeholders, and researchers. Support from policymakers and international funders facilitated KTP activities, while the lack of skilled human resources to conduct EIHP activities impeded KTPs. Ensuring the sustainability of EIHP initiatives after the end of funding was a major challenge for KTPs. KTPs reported that institutionalization within the government has helped to retain human resources and secure funding, whereas KTPs hosted by universities highlighted the advantage of autonomy from political interests.

Conclusions

The establishment of KTPs is a promising development in supporting EIHP. Real-time lesson drawing from the experiences of KTPs can support improvements in the functioning of KTPs in the short term, while making the case for sustaining their work in the long term. Lessons learned can help to promote similar EIHP initiatives in other countries.

A systematic review of barriers to and facilitators of the use of evidence by policymakers

Background

The gap between research and practice or policy is often described as a problem. To identify new barriers of and facilitators to the use of evidence by policymakers, and assess the state of research in this area, we updated a systematic review.

Methods

Systematic review. We searched online databases including Medline, Embase, SocSci Abstracts, CDS, DARE, Psychlit, Cochrane Library, NHSEED, HTA, PAIS, IBSS (Search dates: July 2000 - September 2012). Studies were included if they were primary research or systematic reviews about factors affecting the use of evidence in policy. Studies were coded to extract data on methods, topic, focus, results and population.

Results

145 new studies were identified, of which over half were published after 2010. Thirteen systematic reviews were included. Compared with the original review, a much wider range of policy topics was found. Although still primarily in the health field, studies were also drawn from criminal justice, traffic policy, drug policy, and partnership working. The most frequently reported barriers to evidence uptake were poor access to good quality relevant research, and lack of timely research output. The most frequently reported facilitators were collaboration between researchers and policymakers, and improved relationships and skills. There is an increasing amount of research into new models of knowledge transfer, and evaluations of interventions such as knowledge brokerage.

Conclusions

Timely access to good quality and relevant research evidence, collaborations with policymakers and relationship- and skills-building with policymakers are reported to be the most important factors in influencing the use of evidence. Although investigations into the use of evidence have spread beyond the health field and into more countries, the main barriers and facilitators remained the same as in the earlier review. Few studies provide clear definitions of policy, evidence or policymaker. Nor are empirical data about policy processes or implementation of policy widely available. It is therefore difficult to describe the role of evidence and other factors influencing policy. Future research and policy priorities should aim to illuminate these concepts and processes, target the factors identified in this review, and consider new methods of overcoming the barriers described.

A systematic review of barriers to and facilitators of the use of evidence by policymakers

BACKGROUND

The gap between research and practice or policy is often described as a problem. To identify new barriers of and facilitators to the use of evidence by policymakers, and assess the state of research in this area, we updated a systematic review.

METHODS

Systematic review. We searched online databases including Medline, Embase, SocSci Abstracts, CDS, DARE, Psychlit, Cochrane Library, NHSEED, HTA, PAIS, IBSS (Search dates: July 2000 - September 2012). Studies were included if they were primary research or systematic reviews about factors affecting the use of evidence in policy. Studies were coded to extract data on methods, topic, focus, results and population.

RESULTS

145 new studies were identified, of which over half were published after 2010. Thirteen systematic reviews were included. Compared with the original review, a much wider range of policy topics was found. Although still primarily in the health field, studies were also drawn from criminal justice, traffic policy, drug policy, and partnership working. The most frequently reported barriers to evidence uptake were poor access to good quality relevant research, and lack of timely research output. The most frequently reported facilitators were collaboration between researchers and policymakers, and improved relationships and skills. There is an increasing amount of research into new models of knowledge transfer, and evaluations of interventions such as knowledge brokerage.

CONCLUSIONS

Timely access to good quality and relevant research evidence, collaborations with policymakers and relationship- and skills-building with policymakers are reported to be the most important factors in influencing the use of evidence. Although investigations into the use of evidence have spread beyond the health field and into more countries, the main barriers and facilitators remained the same as in the earlier review. Few studies provide clear definitions of policy, evidence or policymaker. Nor are empirical data about policy processes or implementation of policy widely available. It is therefore difficult to describe the role of evidence and other factors influencing policy. Future research and policy priorities should aim to illuminate these concepts and processes, target the factors identified in this review, and consider new methods of overcoming the barriers described.

Assessing the state of health research in the Eastern Mediterranean Region

Member states across the Eastern Mediterranean region face unprecedented health challenges, buffeted by demographic change, a dual disease burden, rising health costs, and the effects of ongoing conflict and population movements - exacerbated in the near-term by instability arising from recent political upheaval in the Middle East. However, health actors in the region are not well positioned to respond to these challenges because of a dearth of good quality health research. This review presents an assessment of the current state of health research systems across the Eastern Mediterranean based on publicly available literature and data sources. The review finds that - while there have been important improvements in productivity in the Region since the early 1990s - overall research performance is poor with critical deficits in system stewardship, research training and human resource development, and basic data surveillance. Translation of research into policy and practice is hampered by weak institutional and financial incentives, and concerns over the political sensitivity of findings. These problems are attributable primarily to chronic under-investment - both financial and political - in Research and Development systems. This review identifies key areas for a regional strategy and how to address challenges, including increased funding, research capacity-building, reform of governance arrangements and sustained political investment in research support. A central finding is that the poverty of publicly available data on research systems makes meaningful cross-comparisons of performance within the EMR difficult. We therefore conclude by calling for work to improve understanding of health research systems across the region as a matter of urgency.

Measuring factors affecting implementation of health innovations: a systematic review of structural, organizational, provider, patient, and innovation level measures

BACKGROUND

Two of the current methodological barriers to implementation science efforts are the lack of agreement regarding constructs hypothesized to affect implementation success and identifiable measures of these constructs. In order to address these gaps, the main goals of this paper were to identify a multi-level framework that captures the predominant factors that impact implementation outcomes, conduct a systematic review of available measures assessing constructs subsumed within these primary factors, and determine the criterion validity of these measures in the search articles.

METHOD

We conducted a systematic literature review to identify articles reporting the use or development of measures designed to assess constructs that predict the implementation of evidence-based health innovations. Articles published through 12 August 2012 were identified through MEDLINE, CINAHL, PsycINFO and the journal Implementation Science. We then utilized a modified five-factor framework in order to code whether each measure contained items that assess constructs representing structural, organizational, provider, patient, and innovation level factors. Further, we coded the criterion validity of each measure within the search articles obtained.

RESULTS

Our review identified 62 measures. Results indicate that organization, provider, and innovation-level constructs have the greatest number of measures available for use, whereas structural and patient-level constructs have the least. Additionally, relatively few measures demonstrated criterion validity, or reliable association with an implementation outcome (e.g., fidelity).

DISCUSSION

In light of these findings, our discussion centers on strategies that researchers can utilize in order to identify, adapt, and improve extant measures for use in their own implementation research. In total, our literature review and resulting measures compendium increases the capacity of researchers to conceptualize and measure implementation-related constructs in their ongoing and future research.

How hard can it be to include research evidence and evaluation in local health policy implementation? Results from a mixed methods study

Background

Although an evidence-based approach is the ideal model for planning and delivering healthcare, barriers exist to using research evidence to implement and evaluate service change. This paper aims to inform policy implementation and evaluation by understanding the role of research evidence at the local level through implementation of a national chronic conditions management policy.

Methods

We conducted a national email survey of health service commissioners at the most devolved level of decision-making in Wales (Local Health Boards – LHBs) followed by in-depth interviews with representatives of LHBs, purposively selecting five to reflect geographic and economic characteristics. Survey data were analysed descriptively; we used thematic analysis for interview data.

Results

All LHBs (n = 22) completed questionnaires. All reported they routinely assessed the research literature before implementing interventions, but free-text answers revealed wide variation in approach. Most commonly reported information sources included personal contacts, needs assessments, information or research databases. No consistent approach to evaluation was reported. Frequently reported challenges were: insufficient staff capacity (17/22); limited skills, cost, limited time, competing priorities (16/22); availability and quality of routine data (15/22). Respondents reported they would value central guidance on evaluation.

Five interviews were held with managers from the five LHBs contacted. Service delivery decisions were informed by Welsh Government initiatives and priorities, budgets, perceived good practice, personal knowledge, and local needs, but did not include formal research evidence, they reported. Decision making was a collaborative process including clinical staff, patient representatives, and partner organization managers with varying levels of research experience. Robust evaluation data were required, but they were constrained by a lack of skills, time, and resources. They viewed evaluation as a means of demonstrating that targets had been met.

Conclusions

There is a gap between evidence-based aims of national health policy and how health services are commissioned, implemented, and evaluated at local level. Commissioners and managers are unable to routinely incorporate research evidence. If health services research is to identify most effective ways to implement high quality care, it should be incorporated into commissioning and service delivery. Local commissioners and managers need to build the critical use of research evidence and evaluation into health policy implementation at local level in order to provide consistent and effective healthcare services.

Use of health systems evidence by policymakers in eastern Mediterranean countries: views, practices, and contextual influences

Background

Health systems evidence can enhance policymaking and strengthen national health systems. In the Middle East, limited research exists on the use of evidence in the policymaking process. This multi-country study explored policymakers’ views and practices regarding the use of health systems evidence in health policymaking in 10 eastern Mediterranean countries, including factors that influence health policymaking and barriers and facilitators to the use of evidence.

Methods

This study utilized a survey adapted and customized from a similar tool developed in Canada. Health policymakers from 10 countries (Algeria, Bahrain, Jordan, Lebanon Oman, Pakistan, Palestine, Sudan, Tunisia, and Yemen) were surveyed. Descriptive and bi-variate analyses were performed for quantitative questions and thematic analysis was done for qualitative questions.

Results

A total of 237 policymakers completed the survey (56.3% response rate). Governing parties, limited funding for the health sector and donor organizations exerted a strong influence on policymaking processes. Most (88.5%) policymakers reported requesting evidence and 43.1% reported collaborating with researchers. Overall, 40.1% reported that research evidence is not delivered at the right time. Lack of an explicit budget for evidence-informed health policymaking (55.3%), lack of an administrative structure for supporting evidence-informed health policymaking processes (52.6%), and limited value given to research (35.9%) all limited the use of research evidence. Barriers to the use of evidence included lack of research targeting health policy, lack of funding and investments, and political forces. Facilitators included availability of health research and research institutions, qualified researchers, research funding, and easy access to information.

Conclusions

Health policymakers in several countries recognize the importance of using health systems evidence. Study findings are important in light of changes unfolding in some Arab countries and can help undertake an analysis of underlying transformations and their respective health policy implications including the way evidence will be used in policy decisions.

A multi-faceted approach to promote knowledge translation platforms in eastern Mediterranean countries: climate for evidence-informed policy

Objectives

Limited work has been done to promote knowledge translation (KT) in the Eastern Mediterranean Region (EMR). The objectives of this study are to: 1.assess the climate for evidence use in policy; 2.explore views and practices about current processes and weaknesses of health policymaking; 3.identify priorities including short-term requirements for policy briefs; and 4.identify country-specific requirements for establishing KT platforms.

Methods

Senior policymakers, stakeholders and researchers from Algeria, Bahrain, Egypt, Iran, Jordan, Lebanon, Oman, Sudan, Syria, Tunisia, and Yemen participated in this study. Questionnaires were used to assess the climate for use of evidence and identify windows of opportunity and requirements for policy briefs and for establishing KT platforms. Current processes and weaknesses of policymaking were appraised using case study scenarios. Closed-ended questions were analyzed descriptively. Qualitative data was analyzed using thematic analysis.

Results

KT activities were not frequently undertaken by policymakers and researchers in EMR countries, research evidence about high priority policy issues was rarely made available, and interaction between policymakers and researchers was limited, and policymakers rarely identified or created places for utilizing research evidence in decision-making processes. Findings emphasized the complexity of policymaking. Donors, political regimes, economic goals and outdated laws were identified as key drivers. Lack of policymakers’ abilities to think strategically, constant need to make quick decisions, limited financial resources, and lack of competent and trained human resources were suggested as main weaknesses.

Conclusion

Despite the complexity of policymaking processes in countries from this region, the absence of a structured process for decision making, and the limited engagement of policymakers and researchers in KT activities, there are windows of opportunity for moving towards more evidence informed policymaking.