Evidence-based priority setting for health care and research: tools to support policy in maternal, neonatal, and child health in Africa

Strengthening implementation and utilization of nutrition interventions through research: a framework and research agenda

Undernutrition among women and children contributes to almost half the global burden of child mortality in developing countries. The impact of nutrition on economic development has highlighted the need for evidence-based solutions and yielded substantial global momentum. However, it is now recognized that the impact of evidence-based interventions is limited by the lack of evidence on the best operational strategies for scaling up nutrition interventions. With the goal of encouraging greater engagement in implementation research in nutrition and generating evidence on implementation and utilization of nutrition interventions, this paper brings together a framework and a broad analysis of literature to frame and highlight the crucial importance of research on the delivery and utilization of nutrition interventions. The paper draws on the deliberations of a high-level working group, an e-consultation, a conference, and the published literature. It proposes a framework and areas of research that have been quite neglected, and yet are critical to better understanding through careful research to enable better translation of global and national political momentum for nutrition into public health impact.

Neonatal survival in complex humanitarian emergencies: setting an evidence-based research agenda

BACKGROUND

Over 40% of all deaths among children under 5 are neonatal deaths (0-28 days), and this proportion is increasing. In 2012, 2.9 million newborns died, with 99% occurring in low- and middle-income countries. Many of the countries with the highest neonatal mortality rates globally are currently or have recently been affected by complex humanitarian emergencies. Despite the global burden of neonatal morbidity and mortality and risks inherent in complex emergency situations, research investments are not commensurate to burden and little is known about the epidemiology or best practices for neonatal survival in these settings.

METHODS

We used the Child Health and Nutrition Research Initiative (CHNRI) methodology to prioritize research questions on neonatal health in complex humanitarian emergencies. Experts evaluated 35 questions using four criteria (answerability, feasibility, relevance, equity) with three subcomponents per criterion. Using SAS 9.2, a research prioritization score (RPS) and average expert agreement score (AEA) were calculated for each question.

RESULTS

Twenty-eight experts evaluated all 35 questions. RPS ranged from 0.846 to 0.679 and the AEA ranged from 0.667 to 0.411. The top ten research priorities covered a range of issues but generally fell into two categories- epidemiologic and programmatic components of neonatal health. The highest ranked question in this survey was "What strategies are effective in increasing demand for, and use of skilled attendance?"

CONCLUSIONS

In this study, a diverse group of experts used the CHRNI methodology to systematically identify and determine research priorities for neonatal health and survival in complex humanitarian emergencies. The priorities included the need to better understand the magnitude of the disease burden and interventions to improve neonatal health in complex humanitarian emergencies. The findings from this study will provide guidance to researchers and program implementers in neonatal and complex humanitarian fields to engage on the research priorities needed to save lives most at risk.

Budget- and priority-setting criteria at state health agencies in times of austerity: a mixed-methods study

OBJECTIVES

We examined critical budget and priority criteria for state health agencies to identify likely decision-making factors, pressures, and opportunities in times of austerity.

METHODS

We have presented findings from a 2-stage, mixed-methods study with state public health leaders regarding public health budget- and priority-setting processes. In stage 1, we conducted hour-long interviews in 2011 with 45 health agency executive and division or bureau leaders from 6 states. Stage 2 was an online survey of 207 executive and division or bureau leaders from all state health agencies (66% response rate).

RESULTS

Respondents identified 5 key criteria: whether a program was viewed as "mission critical," the seriousness of the consequences of not funding the program, financing considerations, external directives and mandates, and the magnitude of the problem the program addressed.

CONCLUSIONS

We have presented empirical findings on criteria used in state health agency budgetary decision-making. These criteria suggested a focus and interest on core public health and the largest public health problems with the most serious ramifications.

Developing a sustainable nutrition research agenda in sub-Saharan Africa--findings from the SUNRAY project

Patrick Kolsteren and colleagues present the findings of a collaborative effort by stakeholders in sub-Saharan Africa to identify priorities for nutrition research. They propose a new approach that stimulates demand from policy makers for research and holds them accountable for incorporating research into policy and practice. Please see later in the article for the Editors' Summary

Health sector priority setting at meso-level in lower and middle income countries: lessons learned, available options and suggested steps

Setting priority for health programming and budget allocation is an important issue, but there is little consensus on related processes. It is particularly relevant in low resource settings and at province- and district- or "meso-level", where contextual influences may be greater, information scarce and capacity lower. Although recent changes in disease epidemiology and health financing suggest even greater need to allocate resources effectively, the literature is relatively silent on evidence-based priority-setting in low and middle income countries (LMICs). We conducted a comprehensive review of the peer-reviewed and grey literature on health resource priority-setting in LMICs, focussing on meso-level and the evidence-based priority-setting processes (PSPs) piloted or suggested there. Our objective was to assess PSPs according to whether they have influenced resource allocation and impacted the outcome indicators prioritised. An exhaustive search of the peer-reviewed and grey literature published in the last decade yielded 57 background articles and 75 reports related to priority-setting at meso-level in LMICs. Although proponents of certain PSPs still advocate their use, other experts instead suggest broader elements to guide priority-setting. We conclude that currently no process can be confidently recommended for such settings. We also assessed the common reasons for failure at all levels of priority-setting and concluded further that local authorities should additionally consider contextual and systems limitations likely to prevent a satisfactory process and outcomes, particularly at meso-level. Recent literature proposes a list of related attributes and warning signs, and facilitated our preparation of a simple decision-tree or roadmap to help determine whether or not health systems issues should be improved in parallel to support for needed priority-setting; what elements of the PSP need improving; monitoring, and evaluation. Health priority-setting at meso-level in LMICs can involve common processes, but will often require additional attention to local health systems.

Research priority setting for health policy and health systems strengthening in Nigeria: the policymakers and stakeholders perspective and involvement

Introduction

Nigeria is one of the low and middle income countries (LMICs) facing severe resource constraint, making it impossible for adequate resources to be allocated to the health sector. Priority setting becomes imperative because it guides investments in health care, health research and respects resource constraints. The objective of this study was to enhance the knowledge and understanding of policymakers on research priority setting and to conduct a research priority setting exercise.

Methods

A one-day evidence-to-policy research priority setting meeting was held. The meeting participants included senior and middle level policymakers and key decision makers/stakeholders in the health sector in Ebonyi State southeastern Nigeria. The priorities setting meeting involved a training session on priority setting process and conduction of priority setting exercise using the essential national health research (ENHR) approach. The focus was on the health systems building blocks (health workforce; health finance; leadership/governance; medical products/technology; service delivery; and health information/evidence).

Results

Of the total of 92 policymakers invited 90(97.8%) attended the meeting. It was the consensus of the policymakers that research should focus on the challenges of optimal access to health products and technology; effective health service delivery and disease control under a national emergency situation; the shortfalls in the supply of professional personnel; and the issues of governance in the health sector management.

Conclusion

Research priority setting exercise involving policymakers is an example of demand driven strategy in the health policymaking process capable of reversing inequities and strengthening the health systems in LMICs.

Ending of preventable deaths from pneumonia and diarrhoea: an achievable goal

Global under-5 mortality has fallen rapidly from 12 million deaths in 1990, to 6·9 million in 2011; however, this number still falls short of the target of a two-thirds reduction or a maximum of 4 million deaths by 2015. Acceleration of reductions in deaths due to pneumonia and diarrhoea, which together account for about 2 million child deaths every year, is essential if the target is to be met. Scaling up of existing interventions against the two diseases to 80% and immunisation to 90% would eliminate more than two-thirds of deaths from these two diseases at a cost of US$6·715 billion by 2025. Modelling in this report shows that if all countries could attain the rates of decline of the regional leaders, then cause-specific death rates of fewer than three deaths per 1000 livebirths from pneumonia and less than one death per 1000 livebirths from diarrhoea could be achieved by 2025. These rates are those at which preventable deaths have been avoided. Increasing of awareness of the size of the problem; strengthening of leadership, intersectoral collaboration, and resource mobilisation; and increasing of efficiency through the selection of the optimum mix of a growing set of cost-effective interventions depending on local contexts are the priority actions needed to achieve the goal of ending preventable deaths from pneumonia and diarrhoea by 2025.

Translating coverage gains into health gains for all women and children: the quality care opportunity

Wendy Graham and colleagues reflect on quality of maternal health care, the focus of Year 1 of the PLOS-MHTF Maternal Health Collection and its 18 new articles.

Addressing inequity to achieve the maternal and child health millennium development goals: looking beyond averages

BACKGROUND

Inequity in access to and use of child and maternal health interventions is impeding progress towards the maternal and child health Millennium Development Goals. This study explores the potential health gains and equity impact if a set of priority interventions for mothers and under fives were scaled up to reach national universal coverage targets for MDGs in Tanzania.

METHODS

We used the Lives Saved Tool (LiST) to estimate potential reductions in maternal and child mortality and the number of lives saved across wealth quintiles and between rural and urban settings. High impact maternal and child health interventions were modelled for a five-year scale up, by linking intervention coverage, effectiveness and cause of mortality using data from Tanzania. Concentration curves were drawn and the concentration index estimated to measure the equity impact of the scale up.

RESULTS

In the poorest population quintiles in Tanzania, the lives of more than twice as many mothers and under-fives were likely to be saved, compared to the richest quintile. Scaling up coverage to equal levels across quintiles would reduce inequality in maternal and child mortality from a pro rich concentration index of -0.11 (maternal) and -0.12 (children) to a more equitable concentration index of -0,03 and -0.03 respectively. In rural areas, there would likely be an eight times greater reduction in maternal deaths than in urban areas and a five times greater reduction in child deaths than in urban areas.

CONCLUSIONS

Scaling up priority maternal and child health interventions to equal levels would potentially save far more lives in the poorest populations, and would accelerate equitable progress towards maternal and child health MDGs.

Understanding the determinants of the complex interplay between cost-effectiveness and equitable impact in maternal and child mortality reduction

Background

One of the most unexpected outcomes arising from the efforts towards maternal and child mortality reduction is that all too often the objective success has been coupled with increased inequity in the population. The aim of this study is to analyze the determinants of the complex interplay between cost-effectiveness and equity and suggest strategies that will promote an impact on mortality that reduce population child health inequities.

Methods

We developed a conceptual framework that exposes the nature of the links between the five key determinants that need to be taken into account when planning equitable impact. These determinants are: (i) efficiency of intervention scale-up (requires knowledge of differential increase in cost of intervention scale-up by equity strata in the population); (ii) effectiveness of intervention (requires understanding of differential effectiveness of interventions by equity strata in the population); (iii) the impact on mortality (requires knowledge of differential mortality levels by equity strata, and understanding the differences in cause composition of overall mortality in different equity strata); (iv) cost-effectiveness (compares the initial cost and the resulting impact on mortality); (v) equity structure of the population. The framework is presented visually as a four-quadrant graph.

Results

We use the proposed framework to demonstrate why the relationship between cost-effectiveness and equitable impact of an intervention cannot be intuitively predicted or easily planned. The relationships between the five determinants are complex, often nonlinear, context-specific and intervention-specific. We demonstrate that there will be instances when an equity-promoting approach, ie, trying to reach for the poorest and excluded in the population with health interventions, will also be the most cost-effective approach. However, there will be cases in which this will be entirely unfeasible, and where equity-neutral or even inequity-promoting approaches may be substantially more cost-effective. In those cases, investments into health system development among the poorest that would increase the quality and reduce the cost of intervention delivery would be required before intervention scale-up is planned.

Conclusions

The relationships between the most important determinants of cost-effectiveness and equitable impact of health interventions used to reduce maternal and child mortality are highly complex, and the effect on equity cannot be predicted intuitively, or by using simple linear models.

Choosing the best child assessment instrument for a specific context: a methodology for engaging local experts applied in Chile

OBJECTIVE

Chile is considering expanding its system for early childhood development to include 5- to 7-year olds, but it has no consensus about how to identify at-risk children. This study facilitated a process for incorporating local priorities and best practices to choose a child assessment instrument.

METHODS

Using the priority-setting method of the Child Health and Nutrition Research Initiative (CHNRI), 21 Chilean experts defined and weighted ideal assessment instrument characteristics; 130 instruments were scored according to how closely they matched experts' ideal definitions. Instruments were ranked by score under different inclusion criteria.

RESULTS

Experts weighted instrument quality highest (95 on 1-100 scale), followed by administration site (87), domains assessed (82), cost (80), administrator (76), Spanish version (75), time (75), and prior use in Chile (53). Experts agreed that an ideal instrument (1) would reliably assess language, socioemotional well-being, mental health, and parenting abilities, (2) could be administered at schools or home, and (3) could be administered by teachers or parents. No single instrument matched all Chilean priorities. Three instruments met 11 of 13 priorities (age; quality; administration at school, home, or waiting rooms; assess language and socioemotional domains; administered by teachers, parents, or psychologists; time ≤30 minutes). Including mental health or parenting abilities ranked instruments whose composite scores were 35% lower.

CONCLUSION

Decisions about how to assess children at developmental risk should be informed by local context. The CHNRI method provided a useful process that made explicit mutually exclusive priorities, quantified trade-offs of different assessment strategies, and identified 3 of the instruments that best met local needs and priorities.

Prioritizing child health interventions in Ethiopia: modeling impact on child mortality, life expectancy and inequality in age at death

BACKGROUND

The fourth Millennium Development Goal calls for a two-thirds reduction in under-5 mortality between 1990 and 2015. Under-5 mortality rate is declining, but many countries are still far from achieving the goal. Effective child health interventions that could reduce child mortality exist, but national decision-makers lack contextual information for priority setting in their respective resource-constrained settings. We estimate the potential health impact of increasing coverage of 14 selected health interventions on child mortality in Ethiopia (2011-2015). We also explore the impact on life expectancy and inequality in the age of death (Gini(health)).

METHODS AND FINDINGS

We used the Lives Saved Tool to estimate potential impact of scaling-up 14 health interventions in Ethiopia (2011-2015). Interventions are scaled-up to 1) government target levels, 2) 90% coverage and 3) 90% coverage of the five interventions with the highest impact. Under-5 mortality rate, neonatal mortality rate and deaths averted are primary outcome measures. We used modified life tables to estimate impact on life expectancy at birth and inequality in the age of death (Gini(health)). Under-5 mortality rate declines from 101.0 in 2011 to 68.8, 42.1 and 56.7 per 1000 live births under these three scenarios. Prioritizing child health would also increase life expectancy at birth from expected 60.5 years in 2015 to 62.5, 64.2 and 63.4 years and reduce inequality in age of death (Gini(health)) substantially from 0.24 to 0.21, 0.18 and 0.19.

CONCLUSIONS

The Millennium Development Goal for child health is reachable in Ethiopia. Prioritizing child health would also increase total life expectancy at birth and reduce inequality in age of death substantially (Gini(health)).

Global health research priorities: mobilizing the developing world

The paper focuses on two questions: (i) how to set research priorities in a transparent, systematic, fair and legitimate way?; and (ii) how to mobilize low and middle-income countries to take more ownership in defining their own research policies, rather than merely being passive recipients of international aid for research and development? I propose that the recently developed Child Health and Nutrition Research initiative (CHNRI) methodology is becoming widely accepted as a feasible answer to both those questions. In this paper, I review its numerous applications to date and show how it evolved into a practical and systematic tool that can assist priority setting in health research investments in diverse contexts. The CHNRI methodology also addresses support for different instruments of health research to achieve better balance between fundamental research, translation research and implementation research. The wide application of CHNRI methodology is expected to maximise the potential of health research to reduce disease burden and gradually reduce inequities that exist between support for research on the health problems of the rich and the poor. I believe that this tool will find application within many low and middle-income countries and assist them to pull together their own experts and actively define their priorities for research and development in the coming years.

The World Health Report 2012 that wasn't

The PLOS Medicine editors comment on the history of the World Health Organization's latest World Health Report, originally planned for publication in 2012, and the outcomes of the journal's collaboration with WHO on the intended theme of "no health without research".

Developing and costing local strategies to improve maternal and child health: the investment case framework

Eliana Jimenez Soto and colleagues describe the Investment Case framework, a health systems research approach for planning and budgeting, and detail the implementation of the framework in four Asian countries to improve maternal, newborn and child health.

The Program Assessment Guide: an approach for structuring contextual knowledge and experience to improve the design, delivery, and effectiveness of nutrition interventions

As evidence from small-scale trials has accumulated concerning the efficacy of low-cost interventions to address undernutrition, the design, implementation, and strengthening of large-scale programs to deliver these interventions has become a high priority. This scaling up process involves a large number of technical, logistical, administrative, political, and social considerations and little research exists on how to address these in a systematic way. This paper introduces the Program Assessment Guide (PAG), a set of analysis and decision tools that seeks to fill this gap, and reports on its application in Kyrgyzstan and Bolivia. The PAG places a special focus on eliciting and systematizing contextual knowledge and experience through a structured, participatory workshop and is grounded in theory, principles, and experience from program planning, management, change management, and intervention planning. When applied in Kyrgyzstan and Bolivia, the PAG was successful in helping workshop participants identify key implementation bottlenecks, questionable assumptions in the program theory, and feasible ways to address some of the shortcomings. These experiences also identified the need for a number of modifications to the PAG related to the workshop design itself, the preparations prior to the workshop, and follow-up after the workshop. The PAG represents one approach for strengthening decisions related to the design and large-scale implementation of interventions. The development and full-scale testing of alternative methods such as these for strengthening program analysis and decision making is an important and intellectually challenging subject for further research.

Efficacy and effectiveness of 20 child health interventions in China: Systematic review of Chinese literature

AIM

The research production of the Chinese academics for the past few decades, which is being published in more than nine thousands of Chinese academic periodicals, has recently been digitalized and made available in the public domain. The aim of this study was to systematically identify and assess the evidence from Chinese literature sources on the efficacy and effectiveness of child health interventions in China.

METHODS

The Chinese National Knowledge Infrastructure databases were searched for the studies with primary data on efficacy or effectiveness of child health interventions in China between 1980 and 2011. The searches of PubMed and the 'Lives Saved Tool (LiST)' evidence base were also performed to identify the counterpart evidence in the English language.

RESULTS

Of 32 interventions initially identified in the Chinese literature, 20 interventions sustained the primary information addressing efficacy or effectiveness. Among preventive interventions (14 interventions), most studies were dedicated to complementary feeding (7 studies), kangaroo mother care (7 studies) and syphilis detection and treatment (4 studies). Among treatment interventions (6 interventions), the most frequently studied were zinc for treatment of diarrhoea (11 studies) and newborn resuscitation (9 studies). The evidence on efficacy or effectiveness of the 32 interventions conducted in Chinese children in the Chinese literature was either of comparable quality, or more informative than the available reports on China in the English literature, which rarely contained studies on child health intervention effectiveness exclusively in Chinese population. The included studies reported positive results unanimously, implying a likely publication bias.

DISCUSSION

The evidence on the efficacy and effectiveness of child health interventions in China is typically modest in quantity and quality, and implies a notable urban-rural discrepancy in applied health systems research to improve child health interventions and programmes. However, it is clear that considerable research interests and initiatives from both inside and outside the country have been concentrating on implementation, long-term operation, evaluation and further development of child health interventions, especially preventive interventions in China.

A checklist for health research priority setting: nine common themes of good practice

Health research priority setting processes assist researchers and policymakers in effectively targeting research that has the greatest potential public health benefit. Many different approaches to health research prioritization exist, but there is no agreement on what might constitute best practice. Moreover, because of the many different contexts for which priorities can be set, attempting to produce one best practice is in fact not appropriate, as the optimal approach varies per exercise. Therefore, following a literature review and an analysis of health research priority setting exercises that were organized or coordinated by the World Health Organization since 2005, we propose a checklist for health research priority setting that allows for informed choices on different approaches and outlines nine common themes of good practice. It is intended to provide generic assistance for planning health research prioritization processes. The checklist explains what needs to be clarified in order to establish the context for which priorities are set; it reviews available approaches to health research priority setting; it offers discussions on stakeholder participation and information gathering; it sets out options for use of criteria and different methods for deciding upon priorities; and it emphasizes the importance of well-planned implementation, evaluation and transparency.

HIV in maternal and child heath: concurrent crises demand cooperation

The PLoS Medicine editors argue that the time has come to integrate prevention and treatment of HIV into maternal and child health care programs.

Sub-Saharan Africa's mothers, newborns, and children: how many lives could be saved with targeted health interventions?

As part of the series on maternal, neonatal, and child health in sub-Saharan Africa, Robert Black and colleagues estimated mortality reduction for 42 countries and conclude that the use of local data is needed to prioritize the most effective mix of interventions.