[Assessment of Brazilian clinical guidelines in oncology: gaps in drafting, applicability, and editorial independence]

The expansion in the variety of clinical guidelines in oncology is perceptible worldwide, highlighting the need to guarantee the quality of these documents. The study thus aimed to assess the quality of Brazilian national guidelines for treatments of breast, prostate, and colon and rectal cancers. We selected 12 Brazilian guidelines published by four different drafting groups (Ministry of Health, Supplementary Health System, and medical societies and associations), and the AGREE II instrument was applied. In all these guidelines, we identified important weaknesses in more than one Domain, especially low values for "applicability" and "editorial independence". The patterns observed per Domains are more related to the drafting group than the respective clinical conditions. Lower scores in "drafting rigor" and "editorial independence" were obtained by nongovernmental drafting groups, including absence of information or lack of its transparency. Although the "clarity of presentation" in the Ministry of Health guidelines was relatively lower, all the guidelines presented major limitations in "applicability". Consequently, in the overall assessment, none of the guidelines was recommended without modifications, and four were not recommended at all. Finally, it is necessary to upgrade the guidelines according to the underlying evidence ("methodological rigor") and to present the recommended practices in a comprehensible and applicable way ("applicability"), and to mitigate conflicting interests in order to offer cancer patients the best available care in Brazil.

Policy dialogues: facilitators’ perceived role and influence

Purpose

The purpose of this paper is to better understand facilitators’ perceived role and influence on a policy dialogue’s (PD) process and impact. PDs enable interactions between policy makers, researchers and other stakeholders – one of the factors associated with promoting evidence-informed policy making.

Design/methodology/approach

This is an exploratory study based on semi-structured interviews with ten key informants from sub-Saharan Africa, the Middle East, North and South America. Participants were purposefully sampled based on their experience in facilitating or observing PDs organized by the WHO’s Evidence-informed Policy Network. Data were analyzed using a constant comparative method.

Findings

A successful PD relies on a structured process used to catalyze impact. Facilitators contribute to a successful PD through their facilitation skills, for example, helping to get to an informed judgment; knowledge, for example, about the health system; attitudes, for example, valuing the PD process over its outcomes; and personal attributes, for example, credibility. Facilitators’ involvement in preparatory and follow-up actions are equally paramount for a PD’s success. Challenges in implementing PDs can be prevented/attenuated, for example, through stakeholder analysis to identify suitable PD participants, and anticipate power constellations or potential conflicts.

Research limitations/implications

Research should focus on the overall process of a PD – especially on preparation and follow-up activities and their influence on a PD’s success.

Originality/value

Informed by harnessing practical experiences, this paper outlines facilitators’ skills, attributes, attitudes, knowledge and how these can be used to influence a PD’s success.

[Availability of indicators for monitoring the achievement of "Universal Health" in Latin America and the Caribbean]

Objective The objective of this study was to identify the availability of health indicators for validly measuring advances in the attainment of "universal health" in Latin America and the Caribbean (LAC). Methods A systematic search was undertaken for scientific evidence and available technical and scientific documents on assessing health system performance and advances in universal health in the following phases: phase 1, mapping of indicators; phase 2, classification of indicators; and phase 3, mapping the availability of selected indicators in LAC. Results Sixty-three (63) national sources of information and eight international sources were identified. A total of 749 indicators were selected from the different databases and studies evaluated, 619 of which were related to the attainment of universal health and 130 to the burden of disease. The following indicators were identified: financial protection, 42 (6%); coverage of service delivery, 415 (55.4%); population coverage, 6 (0.8%); health determinants, 101 (14%); assessment of inequalities in health, 55 (7.3%); and estimation of burden of disease, 130 (17.3%). Finally, the availability of 141 indicators was mapped for each LAC country. Conclusions The results of this study will help establish a framework for measuring the achievements, obstacles, and rate of progress toward universal health in LAC.

Evidence for Health II: Overcoming barriers to using evidence in policy and practice

Even the highest quality evidence will have little impact unless it is incorporated into decision-making for health. It is therefore critical to overcome the many barriers to using evidence in decision-making, including (1) missing the window of opportunity, (2) knowledge gaps and uncertainty, (3) controversy, irrelevant and conflicting evidence, as well as (4) vested interests and conflicts of interest. While this is certainly not a comprehensive list, it covers a number of main themes discussed in the knowledge translation literature on this topic, and better understanding these barriers can help readers of the evidence to be more savvy knowledge users and help researchers overcome challenges to getting their evidence into practice. Thus, the first step in being able to use research evidence for improving population health is ensuring that the evidence is available at the right time and in the right format and language so that knowledge users can take the evidence into consideration alongside a multitude of other factors that also influence decision-making. The sheer volume of scientific publications makes it difficult to find the evidence that can actually help inform decisions for health. Policymakers, especially in low- and middle-income countries, require context-specific evidence to ensure local relevance. Knowledge synthesis and dissemination of policy-relevant local evidence is important, but it is still not enough. There are times when the interpretation of the evidence leads to various controversies and disagreements, which act as barriers to the uptake of evidence. Research evidence can also be influenced and misused for various aims and agendas. It is therefore important to ensure that any new evidence comes from reliable sources and is interpreted in light of the overall body of scientific literature. It is not enough to simply produce evidence, nor even to synthesize and package evidence into a more user-friendly format. Particularly at the policy level, political savvy is also needed to ensure that vested interests do not undermine decisions that can impact the health of individuals and populations.

Evidence for Health I: Producing evidence for improving health and reducing inequities

In an ideal world, researchers and decision-makers would be involved from the outset in co-producing evidence, with local health needs assessments informing the research agenda and research evidence informing the actions taken to improve health. The first step in improving the health of individuals and populations is therefore gaining a better understanding of what the main health problems are, and of these, which are the most urgent priorities by using both quantitative data to develop a health portrait and qualitative data to better understand why the local population thinks that addressing certain health challenges should be prioritized in their context. Understanding the causes of these health problems often involves analytical research, such as case-control and cohort studies, or qualitative studies to better understand how more complex exposures lead to specific health problems (e.g. by interviewing local teenagers discovering that watching teachers smoke in the school yard, peer pressure, and media influence smoking initiation among youth). Such research helps to develop a logic model to better map out the proximal and distal causes of poor health and to determine potential pathways for intervening and impacting health outcomes. Rarely is there a single 'cure' or stand-alone intervention, but rather, a continuum of strategies are needed from diagnosis and treatment of patients already affected, to disease prevention, health promotion and addressing the upstream social determinants of health. Research for developing and testing more upstream interventions must often go beyond randomized controlled trials, which are expensive, less amenable to more complex interventions, and can be associated with certain ethical challenges. Indeed, a much neglected area of the research cycle is implementation and evaluation research, which often involves quasi-experimental research study designs as well as qualitative research, to better understand how to derive the greatest benefit from existing interventions and ways of maximizing health improvements in specific local contexts. There is therefore a need to alter current incentive structures within the research enterprise to place greater emphasis on implementation and evaluation research conducted in collaboration with knowledge users who are in a position to use the findings in practice to improve health.

Evidence for Health III: Making evidence-informed decisions that integrate values and context

Making evidence-informed decisions with the aim of improving the health of individuals or populations can be facilitated by using a systematic approach. While a number of algorithms already exist, and while there is no single ‘right’ way of summarizing or ordering the various elements that should be involved in making such health-related decisions, an algorithm is presented here that lays out many of the key issues that should be considered, and which adds a special emphasis on balancing the values of individual patients and entire populations, as well as the importance of incorporating contextual considerations. Indeed many different types of evidence and value judgements are needed during the decision-making process to answer a wide range of questions, including (1) What is the priority health problem? (2) What causes this health problem? (3) What are the different strategies or interventions that can be used to address this health problem? (4) Which of these options, as compared to the status quo, has an added benefit that outweighs the harms? (5) Which options would be acceptable to the individuals or populations involved? (6) What are the costs and opportunity costs? (7) Would these options be feasible and sustainable in this specific context? (8) What are the ethical, legal and social implications of choosing one option over another? (9) What do different stakeholders stand to gain or lose from each option? and (10) Taking into account the multiple perspectives and considerations involved, which option is most likely to improve health while minimizing harms? This third and final article in the ‘Evidence for Health’ series will go through each of the steps in the algorithm in greater detail to promote more evidence-informed decisions that aim to improve health and reduce inequities.

Building a knowledge translation platform in Malawi to support evidence-informed health policy

With the support of the World Health Organization's Evidence-Informed Policy Network, knowledge translation platforms have been developed throughout Africa, the Americas, Eastern Europe, and Asia to further evidence-informed national health policy. In this commentary, we discuss the approaches, activities and early lessons learned from the development of a Knowledge Translation Platform in Malawi (KTPMalawi). Through ongoing leadership, as well as financial and administrative support, the Malawi Ministry of Health has strongly signalled its intention to utilize a knowledge translation platform methodology to support evidence-informed national health policy. A unique partnership between Dignitas International, a medical and research non-governmental organization, and the Malawi Ministry of Health, has established KTPMalawi to engage national-level policymakers, researchers and implementers in a coordinated approach to the generation and utilization of health-sector research. Utilizing a methodology developed and tested by knowledge translation platforms across Africa, a stakeholder mapping exercise and initial capacity building workshops were undertaken and a multidisciplinary Steering Committee was formed. This Steering Committee prioritized the development of two initial Communities of Practice to (1) improve data utilization in the pharmaceutical supply chain and (2) improve the screening and treatment of hypertension within HIV-infected populations. Each Community of Practice's mandate is to gather and synthesize the best available global and local evidence and produce evidence briefs for policy that have been used as the primary input into structured deliberative dialogues. While a lack of sustained initial funding slowed its early development, KTPMalawi has greatly benefited from extensive technical support and mentorship by an existing network of global knowledge translation platforms. With the continued support of the Malawi Ministry of Health and the Evidence-Informed Policy Network, KTPMalawi can continue to build on its role in facilitating the use of evidence in the development and refinement of health policy in Malawi.

Informing evidence-based policies for ageing and health in Ghana

Problem

Ghana’s population is ageing. In 2011, the Government of Ghana requested technical support from the World Health Organization (WHO) to help revise national policies on ageing and health.

Approach

We applied WHO’s knowledge translation framework on ageing and health to assist evidence based policy-making in Ghana. First, we defined priority problems and health system responses by performing a country assessment of epidemiologic data, policy review, site visits and interviews of key informants. Second, we gathered evidence on effective health systems interventions in low- middle- and high-income countries. Third, key stakeholders were engaged in a policy dialogue. Fourth, policy briefs were developed and presented to the Ghana Health Services.

Local setting

Ghana has a well-structured health system that can adapt to meet the health care needs of older people.

Relevant changes

Six problems were selected as priorities, however after the policy dialogue, only five were agreed as priorities by the stakeholders. The key stakeholders drafted evidence-based policy recommendations that were used to develop policy briefs. The briefs were presented to the Ghana Health Service in 2014.

Lessons learnt

The framework can be used to build local capacity on evidence-informed policy-making. However, knowledge translation tools need further development to be used in low-income countries and in the field of ageing. The terms and language of the tools need to be adapted to local contexts. Evidence for health system interventions on ageing populations is very limited, particularly for low- and middle-income settings.

Feasibility of a rapid response mechanism to meet policymakers' urgent needs for research evidence about health systems in a low income country: a case study

OBJECTIVES

Despite the recognition of the importance of evidence-informed health policy and practice, there are still barriers to translating research findings into policy and practice. The present study aimed to establish the feasibility of a rapid response mechanism, a knowledge translation strategy designed to meet policymakers' urgent needs for evidence about health systems in a low income country, Uganda. Rapid response mechanisms aim to address the barriers of timeliness and relevance of evidence at the time it is needed.

METHODS

A rapid response mechanism (service) designed a priori was offered to policymakers in the health sector in Uganda. In the form of a case study, data were collected about the profile of users of the service, the kinds of requests for evidence, changes in answers, and courses of action influenced by the mechanism and their satisfaction with responses and the mechanism in general.

RESULTS

We found that in the first 28 months, the service received 65 requests for evidence from 30 policymakers and stakeholders, the majority of whom were from the Ministry of Health. The most common requests for evidence were about governance and organization of health systems. It was noted that regular contact between the policymakers and the researchers at the response service was an important factor in response to, and uptake of the service. The service seemed to increase confidence for policymakers involved in the policymaking process.

CONCLUSION

Rapid response mechanisms designed to meet policymakers' urgent needs for research evidence about health systems are feasible and acceptable to policymakers in low income countries.

Evaluation of the international forum on evidence informed health policymaking: Addis Ababa, Ethiopia - 27 to 31 August 2012

Background

Meetings and conferences are often used as a tool to disseminate information, network with colleagues, and/or set direction for a field of study, but there is little evidence to support whether such events achieve their objectives. This study evaluates the International Forum on Evidence Informed Health Policymaking (EIHP), a three-day meeting held in Addis Ababa, Ethiopia, in 2012, to determine the success of the meeting based on pre-determined objectives.

Methods

The evaluation strategy was developed based on a previously published conference evaluation framework and operationalized as an end-of-conference participant survey that incorporated both process (programme/organization) and outcome measures (potential changes in behaviour).

Results

Sixty seven of approximately 121 attendees filled out a questionnaire (a 55% response rate) and, overall, participants rated the programme components and plenary sessions very highly. The top three benefits reported by participants were: i) sharing experiences and lessons learned (75%); ii) new opportunities for future collaboration (69%); and iii) new knowledge (67%). Conversely, only 25% or less of meeting participants reported an intent to utilize any of the potential benefits highlighted in the questionnaire, with the notable exception of pursuing new opportunities for future collaboration.

Conclusions

The evaluation findings suggest that the International Forum achieved its objectives of sharing experiences with EIHP and providing opportunities for networking among EIHP initiatives, although there are limited prospects for direct improvements to efforts to support EIHP.

Implementation research evidence uptake and use for policy-making

A major obstacle to the progress of the Millennium Development Goals has been the inability of health systems in many low- and middle-income countries to effectively implement evidence-informed interventions. This article discusses the relationships between implementation research and knowledge translation and identifies the role of implementation research in the design and execution of evidence-informed policy. After a discussion of the benefits and synergies needed to translate implementation research into action, the article discusses how implementation research can be used along the entire continuum of the use of evidence to inform policy. It provides specific examples of the use of implementation research in national level programmes by looking at the scale up of zinc for the treatment of childhood diarrhoea in Bangladesh and the scaling up of malaria treatment in Burkina Faso. A number of tested strategies to support the transfer of implementation research results into policy-making are provided to help meet the standards that are increasingly expected from evidence-informed policy-making practices.

Curso ‘Uso de evidências na gestão municipal da saúde’: uma experiência pioneira

É apresentada a experiência do curso Uso de evidências na gestão municipal da saúde, realizado durante o XXVI Congresso do CONASEMS com o objetivo de promover a incorporação da evidência científica como subsídio do processo de tomada de decisão de gestores e profissionais de saúde. O curso foi concebido, planejado e realizado no âmbito das parcerias institucionais da EVIPNet Brasil e seus resultados apontam aspectos relevantes para discussão acerca das estratégias e ferramentas para disseminação e utilização de evidências de pesquisa em saúde na gestão do Sistema Único de Saúde no Brasil.

Translating research into action: WHO evidence-informed guidelines for safe and effective micronutrient interventions

In 2009 WHO adopted a new process by which recommendations for safe and effective micronutrient interventions are developed, ensuring the use of best practices and available evidence. This process includes nine steps ranging from establishing steering and guideline groups and prioritizing needs to planning the implementation and updating the guidelines. Systematic reviews of evidence are used to address critical outcomes for decision making, considering the balance among risks and benefits, values, preferences, and costs. Grading of Recommendations Assessment, Development and Evaluation (GRADE) methodology is used to assess the overall evidence quality and establish the strength of the recommendations. Guideline development is underway for interventions covering iron and vitamin A supplementation, home fortification with multiple micronutrient powders, and fortification of staple foods. Global guidelines are disseminated through the WHO electronic Library of Evidence for Nutrition Actions, a resource of the evidence and tools for scaling-up micronutrient interventions. The WHO Department of Nutrition for Health and Development and the Evidence-Informed Policy Network will support countries to scale-up the delivery of micronutrient interventions by adapting these evidence-informed guidelines and policies to make them context specific. This will be accomplished by providing summaries of the best available evidence on micronutrient interventions, evidence on health systems, and effective delivery systems along with capturing the tacit knowledge of the countries' realities. With a systematic approach that uses the WHO strategy on research for health as the connecting thread, the challenges to successfully implement safe and effective micronutrient programs can be addressed.