Bridging the gaps among research, policy and practice in ten low- and middle-income countries: development and testing of a questionnaire for researchers

Knowledge implementation in health care management: a qualitative study

Background

The gap between knowledge and practice is a global issue, which increases wasteful spending in healthcare. There are several models and frameworks to address this gap and try to solve the challenge. Promoting Action on Research Implementation in Health Services (PARIHS) framework highlights the interaction of three main elements: evidence, context and facilitation, to implement research into practice, successfully. This framework can use as a tool to evaluate the situation and guide the changing. This study conducted to explain the status of knowledge implementation in Iran’s healthcare management system.

Methods

This qualitative study was done by using a directive content analysis approach through conducting in-depth, structured interviews with 15 health managers based on the PARIHS framework. Guiding questions were based on the three main elements of the framework: evidence, context and facilitation. The content of the interviews entered into the Qualitative Data Analysis software (MAXQDA version 10) and, then, analyzed.

Results

The most common source of evidence used by managers for decision-making was local information and previous experience. Evaluation more emphasized compared to other sub-elements of context, i.e. culture and leadership. In terms of facilitation, performing tasks by others was the dominant opinion.

Conclusion

Our results showed that managers in the healthcare system of Iran use their own and other manager’s experience and the local information for decision-making and have no ideas about facilitation.

How is the use of research evidence in health policy perceived? A comparison between the reporting of researchers and policy-makers

Background

The use of health policy and systems research (HPSR) to inform health policy-making is an international challenge. Incorporating HPSR into decision-making primarily involves two groups, namely researchers (knowledge producers) and policy-makers (knowledge users). The purpose of this study was to compare the perceptions of Israeli health systems and policy researchers and health services policy-makers regarding the role of HPSR, factors influencing its uses and potential facilitators and barriers to HPSR, and implementation of knowledge transfer and exchange (KTE) activities.

Methods

A cross-sectional survey was administered to researchers and policy-makers in Israel. The survey consisted of seven closed questions. Descriptive analyses were carried out for closed-ended questions and comparative analysis were conducted between groups using the χ² test.

Results

A total of 37 researchers and 32 policy-makers responded to the survey. While some views were in alignment, others showed differences. More policy-makers than researchers perceived that the use of HPSR in policy was hindered by practical implementation constraints, whereas more researchers felt that its use was hindered by a lack of coordination between knowledge producers and users. A larger percentage of policy-makers, as compared to researchers, reported that facilitators to the KTE process are in place and a larger percentage of researchers perceived barriers within the KTE environment. A larger percentage of policy-makers perceived KTE activities were in place as compared to researchers. Results also showed large differences in the perceptions of the two groups regarding policy formulation and which organisations they perceived as exerting strong influence on policy-making.

Conclusions

This research demonstrated that there are differences in the perceptions of knowledge producers and users about the process of KTE. Future work should focus on minimising the challenges highlighted here and implementing new KTE activities. These activities could include making the researchers aware of the most effective manner in which to package their results, providing training to policy-makers and assuring that policy-makers have technical access to appropriate databases to search for HPSR. These results underscore the need for the groups to communicate and clarify to each other what they can offer and what they require.

Electronic supplementary material

The online version of this article (10.1186/s12961-018-0345-6) contains supplementary material, which is available to authorized users.

Assessing the capacity of ministries of health to use research in decision-making: conceptual framework and tool

Background

The capacity to demand and use research is critical for governments if they are to develop policies that are informed by evidence. Existing tools designed to assess how government officials use evidence in decision-making have significant limitations for low- and middle-income countries (LMICs); they are rarely tested in LMICs and focus only on individual capacity. This paper introduces an instrument that was developed to assess Ministry of Health (MoH) capacity to demand and use research evidence for decision-making, which was tested for reliability and validity in eight LMICs (Bangladesh, Fiji, India, Lebanon, Moldova, Pakistan, South Africa, Zambia).

Methods

Instrument development was based on a new conceptual framework that addresses individual, organisational and systems capacities, and items were drawn from existing instruments and a literature review. After initial item development and pre-testing to address face validity and item phrasing, the instrument was reduced to 54 items for further validation and item reduction. In-country study teams interviewed a systematic sample of 203 MoH officials. Exploratory factor analysis was used in addition to standard reliability and validity measures to further assess the items.

Results

Thirty items divided between two factors representing organisational and individual capacity constructs were identified. South Africa and Zambia demonstrated the highest level of organisational capacity to use research, whereas Pakistan and Bangladesh were the lowest two. In contrast, individual capacity was highest in Pakistan, followed by South Africa, whereas Bangladesh and Lebanon were the lowest.

Conclusion

The framework and related instrument represent a new opportunity for MoHs to identify ways to understand and improve capacities to incorporate research evidence in decision-making, as well as to provide a basis for tracking change.

Electronic supplementary material

The online version of this article (doi:10.1186/s12961-017-0227-3) contains supplementary material, which is available to authorized users.

Exploring health researchers' perceptions of policymaking in Argentina: a qualitative study

Much of the published research on evidence-informed health policymaking in low- and middle-income countries has focused on policymakers, overlooking the role of health researchers in the research-to-policy process. Through 20 semi-structured, in-depth qualitative interviews conducted with researchers in Argentina's rural northwest and the capital of Buenos Aires, we explore the perspectives, experiences and attitudes of Argentine health researchers regarding the use and impact of health research in policymaking in Argentina. We find that the researcher, and the researcher's function of generating evidence, is nested within a broader complex system that influences the researcher's interaction with policymaking. This system comprises communities of practice, government departments/civil society organizations, bureaucratic processes and political governance and executive leadership. At the individual level, researcher capacity and determinants of research availability also play a role in contributing to evidence-informed policymaking. In addition, we find a recurrent theme around 'lack of trust' and explore the role of trust within a research system, finding that researchers' distrust towards policymakers and even other researchers are linked inextricably to the sociopolitical history of Argentina, which contributes to shaping researchers' identities in opposition to policymakers. For policymakers, national research councils and funders of national health research systems, this article provides a deeper understanding of researchers' perceptions which can help inform and improve programme design when developing interventions to enhance research utilization and develop equitable and rational health policies. For donors and development agencies interested in health research capacity building and achieving development goals, this research demonstrates a need for investment in building research capacity and training health researchers to interact with the public policy 'world' and enhancing research communications and transferability to decision makers. It also highlights an opportunity to invest in implementation research platforms, such as health policy research and analysis institutions.

Views of health system policymakers on the role of research in health policymaking in Israel

Background

The use of research evidence in health policymaking is an international challenge. Health systems, including that of Israel, are usually characterized by scarce resources and the necessity to make rapid policy decisions. Knowledge transfer and exchange (KTE) has emerged as a paradigm to start bridging the “know-do” gap. The purpose of this study was to explore the views of health system policymakers and senior executives involved in the policy development process in Israel regarding the role of health systems and policy research (HSPR) in health policymaking, the barriers and facilitators to the use of evidence in the policymaking process, and suggestions for improving the use of HSPR in the policymaking process.

Methods

A survey and an interview were verbally administered in a single face-to-face meeting with health system policymakers and senior executives involved in the policy development process in Israel. The data collection period was from July to October 2014. The potential participants included members of Knesset, officials from Israel’s Ministry of Health, Ministry of Finance, health services organizations, and other stakeholder organizations (i.e., National Insurance Institute). The close-ended questions were based on previous surveys that had been conducted in this field. Interviews were tape recorded and transcribed. Descriptive statistics were conducted for close ended survey-questions and thematic analysis was conducted for open-ended interview questions.

Results

There were 32 participants in this study. Participants felt that the use of HSPR helps raise awareness on policy issues, yet the actual use of HSPR was hindered for many reasons. Facilitators do exist to support the use of HSPR in the policymaking process, such as a strong foundation of relationships between researchers and policymakers. However, many barriers exist such as the lack of relevance and timeliness of much of the currently available research to support decision-making and the paucity of funding to support research use. Suggestions to improve the use of HSPR focused on improving dissemination of research findings and ensuring that the research was more relevant and timely.

Conclusions

This research demonstrated that health systems policymakers in Israel perceive having strong relationships and collaborations with researchers however there is room for improvement, e.g. partnering in research projects to ensure relevance and use. Furthermore, health system policymakers seem to be interested in receiving relevant research in a more useable format and are open to using research in decision making.

Clinicians' knowledge and practices regarding family planning and intrauterine devices in China, Kazakhstan, Laos and Mexico

BACKGROUND

It is widely agreed that the practices of clinicians should be based on the best available research evidence, but too often this evidence is not reliably disseminated to people who can make use of it. This "know-do" gap leads to ineffective resource use and suboptimal provision of services, which is especially problematic in low- and middle-income countries (LMICs) which face greater resource limitations. Family planning, including intrauterine device (IUD) use, represents an important area to evaluate clinicians' knowledge and practices in order to make improvements.

METHODS

A questionnaire was developed, tested and administered to 438 individuals in China (n = 115), Kazakhstan (n = 110), Laos (n = 105), and Mexico (n = 108). The participants responded to ten questions assessing knowledge and practices relating to contraception and IUDs, and a series of questions used to determine their individual characteristics and working context. Ordinal logistic regressions were conducted with knowledge and practices as dependent variables.

RESULTS

Overall, a 96 % response rate was achieved (n = 438/458). Only 2.8 % of respondents were able to correctly answer all five knowledge-testing questions, and only 0.9 % self-reported "often" undertaking all four recommended clinical practices and "never" performing the one practice that was contrary to recommendation. Statistically significant factors associated with knowledge scores included: 1) having a masters or doctorate degree; and 2) often reading scientific journals from high-income countries. Significant factors associated with recommended practices included: 1) training in critically appraising systematic reviews; 2) training in the care of patients with IUDs; 3) believing that research performed in their own country is above average or excellent in quality; 4) being based in a facility operated by an NGO; and 5) having the view that higher quality available research is important to improving their work.

CONCLUSIONS

This analysis supports previous work emphasizing the need for improved knowledge and practices among clinicians concerning the use of IUDs for family planning. It also identifies areas in which targeted interventions may prove effective. Assessing opportunities for increasing education and training programs for clinicians in research and IUD provision could prove to be particularly effective.

Surveying the Knowledge and Practices of Health Professionals in China, India, Iran, and Mexico on Treating Tuberculosis

Research evidence continues to reveal findings important for health professionals' clinical practices, yet it is not consistently disseminated to those who can use it. The resulting deficits in knowledge and service provision may be especially pronounced in low- and middle-income countries that have greater resource constraints. Tuberculosis treatment is an important area for assessing professionals' knowledge and practices because of the effectiveness of existing treatments and recognized gaps in professionals' knowledge about treatment. This study surveyed 384 health professionals in China, India, Iran, and Mexico on their knowledge and practices related to tuberculosis treatment. Few respondents correctly answered all five knowledge questions (12%) or self-reported performing all five recommended clinical practices "often or very often" (3%). Factors associated with higher knowledge scores included clinical specialization and working with researchers. Factors associated with better practices included training in the care of tuberculosis patients, being based in a hospital, trusting systematic reviews of randomized controlled double-blind trials, and reading summaries of articles, reports, and reviews. This study highlights several strategies that may prove effective in improving health professionals' knowledge and practices related to tuberculosis treatment. Facilitating interactions with researchers and training in acquiring systematic reviews may be especially helpful.

Health systems and policy research evidence in health policy making in Israel: what are researchers' practices in transferring knowledge to policy makers?

Background

Ensuring the use of research evidence in health system management and policy decisions is an important challenge in this century. Knowledge transfer and exchange (KTE) has emerged as a paradigm to address the challenges and start closing the ‘know-do’ gap. This area of work is gaining momentum in most developed countries, yet, to date, no work has been performed in Israel within this area. The purpose of this study was to identify which KTE activities health systems and policy researchers in Israel have undertaken.

Methods

A cross-sectional web-based survey of researchers who have conducted health systems and policy research in Israel was developed. The survey consisted of a demographics section, quantitative scales, and open-ended questions. The survey was sent to all health systems and policy researchers in Israel (n = 125).

Results

The study response rate (28%) was relatively low as compared to other studies in the same field (range of 42% to 88%). Our survey found that more than a third of the health systems and policy researchers in Israel reported that they were frequently or always involved in the following KTE activities: interactions with target audience through the research process (i.e., during developing a research question or executing the research; 35% to 42%) or through formal or informal meetings during conferences, workshops, or conversations (40%). Less than half of the health systems and policy researchers in Israel are engaged in bridging activities aimed to facilitate target audiences to use research.

Conclusions

This is a fairly new area in Israel and therefore the level of engagement of researchers in KTE activities is not very high. The low response rates could be because KTE is a new field in Israel and minimal KTE initiatives have been undertaken. It is preferable to have higher response rates, yet, after several initiatives, this was the outcome. While the findings are relevant, they may not reflect the total population of health system and policy researchers in Israel. Health system and policy researchers in Israel need to be introduced to the benefits and potential advantages of KTE in an organized and systematic way.

Capturing lessons learned from evidence-to-policy initiatives through structured reflection

Background

Knowledge translation platforms (KTPs), which are partnerships between policymakers, stakeholders, and researchers, are being established in low- and middle-income countries (LMICs) to enhance evidence-informed health policymaking (EIHP). This study aims to gain a better understanding of the i) activities conducted by KTPs, ii) the way in which KTP leaders, policymakers, and stakeholders perceive these activities and their outputs, iii) facilitators that support KTP work and challenges, and the lessons learned for overcoming such challenges, and iv) factors that can help to ensure the sustainability of KTPs.

Methods

This paper triangulated qualitative data from: i) 17 semi-structured interviews with 47 key informants including KTP leaders, policymakers, and stakeholders from 10 KTPs; ii) document reviews, and iii) observation of deliberations at the International Forum on EIHP in LMICs held in Addis Ababa in August 2012. Purposive sampling was used and data were analyzed using thematic analysis.

Results

Deliberative dialogues informed by evidence briefs were identified as the most commendable tools by interviewees for enhancing EIHP. KTPs reported that they have contributed to increased awareness of the importance of EIHP and strengthened relationships among policymakers, stakeholders, and researchers. Support from policymakers and international funders facilitated KTP activities, while the lack of skilled human resources to conduct EIHP activities impeded KTPs. Ensuring the sustainability of EIHP initiatives after the end of funding was a major challenge for KTPs. KTPs reported that institutionalization within the government has helped to retain human resources and secure funding, whereas KTPs hosted by universities highlighted the advantage of autonomy from political interests.

Conclusions

The establishment of KTPs is a promising development in supporting EIHP. Real-time lesson drawing from the experiences of KTPs can support improvements in the functioning of KTPs in the short term, while making the case for sustaining their work in the long term. Lessons learned can help to promote similar EIHP initiatives in other countries.

Contribution mapping: a method for mapping the contribution of research to enhance its impact

Background

At a time of growing emphasis on both the use of research and accountability, it is important for research funders, researchers and other stakeholders to monitor and evaluate the extent to which research contributes to better action for health, and find ways to enhance the likelihood that beneficial contributions are realized. Past attempts to assess research 'impact' struggle with operationalizing 'impact', identifying the users of research and attributing impact to research projects as source. In this article we describe Contribution Mapping, a novel approach to research monitoring and evaluation that aims to assess contributions instead of impacts. The approach focuses on processes and actors and systematically assesses anticipatory efforts that aim to enhance contributions, so-called alignment efforts. The approach is designed to be useful for both accountability purposes and for assisting in better employing research to contribute to better action for health.

Methods

Contribution Mapping is inspired by a perspective from social studies of science on how research and knowledge utilization processes evolve. For each research project that is assessed, a three-phase process map is developed that includes the main actors, activities and alignment efforts during research formulation, production and knowledge extension (e.g. dissemination and utilization). The approach focuses on the actors involved in, or interacting with, a research project (the linked actors) and the most likely influential users, who are referred to as potential key users. In the first stage, the investigators of the assessed project are interviewed to develop a preliminary version of the process map and first estimation of research-related contributions. In the second stage, potential key-users and other informants are interviewed to trace, explore and triangulate possible contributions. In the third stage, the presence and role of alignment efforts is analyzed and the preliminary results are shared with relevant stakeholders for feedback and validation. After inconsistencies are clarified or described, the results are shared with stakeholders for learning, improvement and accountability purposes.

Conclusion

Contribution Mapping provides an interesting alternative to existing methods that aim to assess research impact. The method is expected to be useful for research monitoring, single case studies, comparing multiple cases and indicating how research can better be employed to contribute to better action for health.

Assessing healthcare providers' knowledge and practices relating to insecticide-treated nets and the prevention of malaria in Ghana, Laos, Senegal and Tanzania

BACKGROUND

Research evidence is not always being disseminated to healthcare providers who need it to inform their clinical practice. This can result in the provision of ineffective services and an inefficient use of resources, the implications of which might be felt particularly acutely in low- and middle-income countries. Malaria prevention is a particularly compelling domain to study evidence/practice gaps given the proven efficacy, cost-effectiveness and disappointing utilization of insecticide-treated nets (ITNs).

METHODS

This study compares what is known about ITNs to the related knowledge and practices of healthcare providers in four low- and middle-income countries. A new questionnaire was developed, pilot tested, translated and administered to 497 healthcare providers in Ghana (140), Laos (136), Senegal (100) and Tanzania (121). Ten questions tested participants' knowledge and clinical practice related to malaria prevention. Additional questions addressed their individual characteristics, working context and research-related activities. Ordinal logistic regressions with knowledge and practices as the dependent variable were conducted in addition to descriptive statistics.

RESULTS

The survey achieved a 75% response rate (372/497) across Ghana (107/140), Laos (136/136), Senegal (51/100) and Tanzania (78/121). Few participating healthcare providers correctly answered all five knowledge questions about ITNs (13%) or self-reported performing all five clinical practices according to established evidence (2%). Statistically significant factors associated with higher knowledge within each country included: 1) training in acquiring systematic reviews through the Cochrane Library (OR 2.48, 95% CI 1.30-4.73); and 2) ability to read and write English well or very well (OR 1.69, 95% CI 1.05-2.70). Statistically significant factors associated with better clinical practices within each country include: 1) reading scientific journals from their own country (OR 1.67, 95% CI 1.10-2.54); 2) working with researchers to improve their clinical practice or quality of working life (OR 1.44, 95% CI 1.04-1.98); 3) training on malaria prevention since their last degree (OR 1.68, 95% CI 1.17-2.39); and 4) easy access to the internet (OR 1.52, 95% CI 1.08-2.14).

CONCLUSIONS

Improving healthcare providers' knowledge and practices is an untapped opportunity for expanding ITN utilization and preventing malaria. This study points to several strategies that may help bridge the gap between what is known from research evidence and the knowledge and practices of healthcare providers. Training on acquiring systematic reviews and facilitating internet access may be particularly helpful.

How should we assess knowledge translation in research organizations; designing a knowledge translation self-assessment tool for research institutes (SATORI)

Background

The knowledge translation self-assessment tool for research institutes (SATORI) was designed to assess the status of knowledge translation in research institutes. The objective was, to identify the weaknesses and strengths of knowledge translation in research centres and faculties associated with Tehran University of Medical Sciences (TUMS).

Methods

The tool, consisting of 50 statements in four main domains, was used in 20 TUMS-affiliated research centres and departments after its reliability was established. It was completed in a group discussion by the members of the research council, researchers and research users' representatives from each centre and/or department.

Results

The mean score obtained in the four domains of 'The question of research', 'Knowledge production', 'Knowledge transfer' and 'Promoting the use of evidence' were 2.26, 2.92, 2 and 1.89 (out of 5) respectively.

Nine out of 12 interventional priorities with the lowest quartile score were related to knowledge transfer resources and strategies, whereas eight of them were in the highest quartile and related to 'The question of research' and 'Knowledge production'.

Conclusions

The self-assessment tool identifies the gaps in capacity and infrastructure of knowledge translation support within research organizations. Assessment of research institutes using SATORI pointed out that strengthening knowledge translation through provision of financial support for knowledge translation activities, creating supportive and facilitating infrastructures, and facilitating interactions between researchers and target audiences to exchange questions and research findings are among the priorities of research centres and/or departments.

Bridging the gaps between research, policy and practice in low- and middle-income countries: a survey of researchers

BACKGROUND

Many international statements have urged researchers, policy-makers and health care providers to collaborate in efforts to bridge the gaps between research, policy and practice in low- and middle-income countries. We surveyed researchers in 10 countries about their involvement in such efforts.

METHODS

We surveyed 308 researchers who conducted research on one of four clinical areas relevant to the Millennium Development Goals (prevention of malaria, care of women seeking contraception, care of children with diarrhea and care of patients with tuberculosis) in each of 10 low- and middle-income countries (China, Ghana, India, Iran, Kazakhstan, Laos, Mexico, Pakistan, Senegal and Tanzania). We focused on their engagement in three promising bridging activities and examined system-level, organizational and individual correlates of these activities.

RESULTS

Less than half of the researchers surveyed reported that they engaged in one or more of the three promising bridging activities: 27% provided systematic reviews of the research literature to their target audiences, 40% provided access to a searchable database of research products on their topic, and 43% established or maintained long-term partnerships related to their topic with representatives of the target audience. Three factors emerged as statistically significant predictors of respondents' engagement in these activities: the existence of structures and processes to link researchers and their target audiences predicted both the provision of access to a database (odds ratio [OR] 2.62, 95% CI 1.30-5.27) and the establishment or maintenance of partnerships (OR 2.65, 95% CI 1.25-5.64); stability in their contacts predicted the provision of systematic reviews (OR 2.88, 95% CI 1.35-6.13); and having managers and public (government) policy-makers among their target audiences predicted the provision of both systematic reviews (OR 4.57, 95% CI 1.78-11.72) and access to a database (OR 2.55, 95% CI 1.20-5.43).

INTERPRETATION

Our findings suggest potential areas for improvement in light of the bridging strategies targeted at health care providers that have been found to be effective in some contexts and the factors that appear to increase the prospects for using research in policy-making.

Bridging the gaps among research, policy and practice in ten low- and middle-income countries: development and testing of questionnaire for health-care providers

BACKGROUND

The reliability and validity of instruments used to survey health-care providers' views about and experiences with research evidence have seldom been examined.

METHODS

Country teams from ten low- and middle-income countries (China, Ghana, India, Iran, Kazakhstan, Laos, Mexico, Pakistan, Senegal and Tanzania) participated in the development, translation, pilot-testing and administration of a questionnaire designed to measure health-care providers' views and activities related to improving their clinical practice and their awareness of, access to and use of research evidence, as well as changes in their clinical practice that they attribute to particular sources of research evidence that they have used. We use internal consistency as a measure of the questionnaire's reliability and, whenever possible, we use explanatory factor analyses to assess the degree to which questions that pertain to a single domain actually address common themes. We assess the questionnaire's face validity and content validity and, to a lesser extent, we also explore its criterion validity.

RESULTS

The questionnaire has high internal consistency, with Cronbach's alphas between 0.7 and 0.9 for 16 of 20 domains and sub-domains (identified by factor analyses). Cronbach's alphas are greater than 0.9 for two domains, suggesting some item redundancy. Pre- and post-field work assessments indicate the questionnaire has good face validity and content validity. Our limited assessment of criterion validity shows weak but statistically significant associations between the general influence of research evidence among providers and more specific measures of providers' change in approach to preventing or treating a clinical condition.

CONCLUSION

Our analysis points to a number of strengths of the questionnaire--high internal consistency (reliability) and good face and content validity--but also to areas where it can be shortened without losing important conceptual domains.