Methods for evaluating effectiveness and cost-effectiveness of a Skilled Care Initiative in rural Burkina Faso

Impact of Birth Preparedness and Complication Readiness Interventions on Birth with a Skilled Attendant: A Systematic Review

BACKGROUND

Increased preparedness for birth and complications is an essential part of antenatal care and has the potential to increase birth with a skilled attendant. We conducted a systematic review of studies to assess the effect of birth preparedness and complication readiness interventions on increasing birth with a skilled attendant.

METHODS

PubMed, Embase, CINAHL and grey literature were searched for studies from 2000 to 2012 using a broad range of search terms. Studies were included with diverse designs and intervention strategies that contained an element of birth preparedness and complication readiness. Data extracted included population, setting, study design, outcomes, intervention description, type of intervention strategy and funding sources. Quality of the studies was assessed. The studies varied in BP/CR interventions, design, use of control groups, data collection methods, and outcome measures. We therefore deemed meta-analysis was not appropriate and conducted a narrative synthesis of the findings.

RESULTS

Thirty-three references encompassing 20 different intervention programmes were included, of which one programmatic element was birth preparedness and complication readiness. Implementation strategies were diverse and included facility-, community-, or home-based services. Thirteen studies resulted in an increase in birth with a skilled attendant or facility birth. The majority of authors reported an increase in knowledge on birth preparedness and complication readiness.

CONCLUSIONS

Birth Preparedness and Complication Readiness interventions can increase knowledge of preparations for birth and complications; however this does not always correspond to an increase in the use of a skilled attendant at birth.

Essential evidence for guiding health system priorities and policies: anticipating epidemiological transition in Africa

Background

Despite indications that infection-related mortality in sub-Saharan Africa may be decreasing and the burden of non-communicable diseases increasing, the overwhelming reality is that health information systems across most of sub-Saharan Africa remain too weak to track epidemiological transition in a meaningful and effective way.

Proposals

We propose a minimum dataset as the basis of a functional health information system in countries where health information is lacking. This would involve continuous monitoring of cause-specific mortality through routine civil registration, regular documentation of exposure to leading risk factors, and monitoring effective coverage of key preventive and curative interventions in the health sector. Consideration must be given as to how these minimum data requirements can be effectively integrated within national health information systems, what methods and tools are needed, and ensuring that ethical and political issues are addressed. A more strategic approach to health information systems in sub-Saharan African countries, along these lines, is essential if epidemiological changes are to be tracked effectively for the benefit of local health planners and policy makers.

Conclusion

African countries have a unique opportunity to capitalize on modern information and communications technology in order to achieve this. Methodological standards need to be established and political momentum fostered so that the African continent's health status can be reliably tracked. This will greatly strengthen the evidence base for health policies and facilitate the effective delivery of services.

The impact of official development aid on maternal and reproductive health outcomes: a systematic review

BACKGROUND

Progress toward meeting Millennium Development Goal 5, which aims to improve maternal and reproductive health outcomes, is behind schedule. This is despite ever increasing volumes of official development aid targeting the goal, calling into question the distribution and efficacy of aid. The 2005 Paris Declaration on Aid Effectiveness represented a global commitment to reform aid practices in order to improve development outcomes, encouraging a shift toward collaborative aid arrangements which support the national plans of aid recipient countries (and discouraging unaligned donor projects).

METHODS AND FINDINGS

We conducted a systematic review to summarise the evidence of the impact on MDG 5 outcomes of official development aid delivered in line with Paris aid effectiveness principles and to compare this with the impact of aid in general on MDG 5 outcomes. Searches of electronic databases identified 30 studies reporting aid-funded interventions designed to improve maternal and reproductive health outcomes. Aid interventions appear to be associated with small improvements in the MDG indicators, although it is not clear whether changes are happening because of the manner in which aid is delivered. The data do not allow for a meaningful comparison between Paris style and general aid. The review identified discernible gaps in the evidence base on aid interventions targeting MDG 5, notably on indicators MDG 5.4 (adolescent birth rate) and 5.6 (unmet need for family planning).

DISCUSSION

This review presents the first systematic review of the impact of official development aid delivered according to the Paris principles and aid delivered outside this framework on MDG 5 outcomes. Its findings point to major gaps in the evidence base and should be used to inform new approaches and methodologies aimed at measuring the impact of official development aid.

Probabilistic methods for verbal autopsy interpretation: InterVA robustness in relation to variations in a priori probabilities

Background

InterVA is a probabilistic method for interpreting verbal autopsy (VA) data. It uses a priori approximations of probabilities relating to diseases and symptoms to calculate the probability of specific causes of death given reported symptoms recorded in a VA interview. The extent to which InterVA's ability to characterise a population's mortality composition might be sensitive to variations in these a priori probabilities was investigated.

Methods

A priori InterVA probabilities were changed by 1, 2 or 3 steps on the logarithmic scale on which the original probabilities were based. These changes were made to a random selection of 25% and 50% of the original probabilities, giving six model variants. A random sample of 1,000 VAs from South Africa, were used as a basis for experimentation and were processed using the original InterVA model and 20 random instances of each of the six InterVA model variants. Rank order of cause of death and cause-specific mortality fractions (CSMFs) from the original InterVA model and the mean, maximum and minimum results from the 20 randomly modified InterVA models for each of the six variants were compared.

Results

CSMFs were functionally similar between the original InterVA model and the models with modified a priori probabilities such that even the CSMFs based on the InterVA model with the greatest degree of variation in the a priori probabilities would not lead to substantially different public health conclusions. The rank order of causes were also similar between all versions of InterVA.

Conclusion

InterVA is a robust model for interpreting VA data and even relatively large variations in a priori probabilities do not affect InterVA-derived results to a great degree. The original physician-derived a priori probabilities are likely to be sufficient for the global application of InterVA in settings without routine death certification.

Methodology and tools for quality improvement in maternal and newborn health care

OBJECTIVE

To gain an overview of approaches, methodologies, and tools used in quality improvement of maternal and newborn health in low-income countries.

METHODS

Electronic search of MEDLINE and organizational databases for literature describing approaches, methodologies, and tools used to improve the quality of maternal and newborn health care in low-income countries. Relevant papers and reports were reviewed and summarized.

RESULTS

Developing a culture of quality is an important requisite for successful quality improvement. Methodologies to improve quality include the development of standards and guidelines and the performance of mortality, near-miss, and criterion-based audits. Tools for data collection and process description were identified, and examples of work to improve quality of care are provided.

CONCLUSION

The documented experience with the identified approaches, methodologies, and tools indicates that none is sufficient by itself to achieve a desirable improvement in quality of care. The choice of methodologies and tools depends on the healthcare system and its available resources. There is a lack of studies that describe the process of quality improvement and a need for research to provide evidence of the effectiveness of the identified methods and tools.

Care during labor and birth for the prevention of intrapartum-related neonatal deaths: a systematic review and Delphi estimation of mortality effect

Background

Our objective was to estimate the effect of various childbirth care packages on neonatal mortality due to intrapartum-related events (“birth asphyxia”) in term babies for use in the Lives Saved Tool (LiST).

Methods

We conducted a systematic literature review to identify studies or reviews of childbirth care packages as defined by United Nations norms (basic and comprehensive emergency obstetric care, skilled care at birth). We also reviewed Traditional Birth Attendant (TBA) training. Data were abstracted into standard tables and quality assessed by adapted GRADE criteria. For interventions with low quality evidence, but strong GRADE recommendation for implementation, an expert Delphi consensus process was conducted to estimate cause-specific mortality effects.

Results

We identified evidence for the effect on perinatal/neonatal mortality of emergency obstetric care packages: 9 studies (8 observational, 1 quasi-experimental), and for skilled childbirth care: 10 studies (8 observational, 2 quasi-experimental). Studies were of low quality, but the GRADE recommendation for implementation is strong. Our Delphi process included 21 experts representing all WHO regions and achieved consensus on the reduction of intrapartum-related neonatal deaths by comprehensive emergency obstetric care (85%), basic emergency obstetric care (40%), and skilled birth care (25%). For TBA training we identified 2 meta-analyses and 9 studies reporting mortality effects (3 cRCT, 1 quasi-experimental, 5 observational). There was substantial between-study heterogeneity and the overall quality of evidence was low. Because the GRADE recommendation for TBA training is conditional on the context and region, the effect was not estimated through a Delphi or included in the LiST tool.

Conclusion

Evidence quality is rated low, partly because of challenges in undertaking RCTs for obstetric interventions, which are considered standard of care. Additional challenges for evidence interpretation include varying definitions of obstetric packages and inconsistent measurement of mortality outcomes. Thus, the LiST effect estimates for skilled birth and emergency obstetric care were based on expert opinion. Using LiST modelling, universal coverage of comprehensive obstetric care could avert 591,000 intrapartum-related neonatal deaths each year. Investment in childbirth care packages should be a priority and accompanied by implementation research and further evaluation of intervention impact and cost.

Funding

This work was supported by the Bill and Melinda Gates Foundation through a grant to the US Fund for UNICEF, and to Saving Newborn Lives Save the Children, through Save the Children US.

A lost cause? Extending verbal autopsy to investigate biomedical and socio-cultural causes of maternal death in Burkina Faso and Indonesia

Maternal mortality in developing countries is characterised by disadvantage and exclusion. Women who die whilst pregnant are typically poor and live in low-income and rural settings where access to quality care is constrained and where deaths, within and outside hospitals, often go unrecorded and unexamined. Verbal autopsy (VA) is an established method of determining cause(s) of death for people who die outside health facilities or without proper registration. This study extended VA to investigate socio-cultural factors relevant to outcomes. Interviews were conducted with relatives of 104 women who died during pregnancy, childbirth or postpartum in two rural districts in Indonesia and for 70 women in a rural district in Burkina Faso. Information was collected on medical signs and symptoms of the women prior to death and an extended section collected accounts of care pathways and opinions on preventability and cause of death. Illustrative quantitative and qualitative analyses were performed and the implications for health surveillance and planning were considered. The cause of death profiles were similar in both settings with infectious diseases, haemorrhage and malaria accounting for half the deaths. In both settings, delays in seeking, reaching and receiving care were reported by more than two-thirds of respondents. Relatives also provided information on their experiences of the emergencies revealing culturally-derived systems of explanation, causation and behaviour. Comparison of the qualitative and quantitative results suggested that the quantified delays may have been underestimated. The analysis suggests that broader empirical frameworks can inform more complete health planning by situating medical conditions within the socio-economic and cultural landscapes in which healthcare is situated and sought. Utilising local knowledge, extended VA has potential to inform the relative prioritisation of interventions that improve technical aspects of life-saving services with those that address the conditions that underlie health, for those whom services typically fail to reach.

Verbal autopsy: methods in transition

Understanding of global health and changing morbidity and mortality is limited by inadequate measurement of population health. With fewer than one-third of deaths worldwide being assigned a cause, this long-standing dearth of information, almost exclusively in the world's poorest countries, hinders understanding of population health and limits opportunities for planning, monitoring, and evaluating interventions. In the absence of routine death registration, verbal autopsy (VA) methods are used to derive probable causes of death. Much effort has been put into refining the approach for specific purposes; however, there has been a lack of harmony regarding such efforts. Subsequently, a variety of methods and principles have been developed, often focusing on a single aspect of VA, and the resulting literature provides an inconsistent picture. By reviewing methodological and conceptual issues in VA, it is evident that VA cannot be reduced to a single one-size-fits-all tool. VA must be contextualized; given the lack of "gold standards," methodological developments should not be considered in terms of absolute validity but rather in terms of consistency, comparability, and adequacy for the intended purpose. There is an urgent need for clarified thinking about the overall objectives of population-level cause-of-death measurement and harmonized efforts in empirical methodological research.

Accessibility and utilisation of delivery care within a Skilled Care Initiative in rural Burkina Faso

OBJECTIVES

The Skilled Care Initiative (SCI) was a comprehensive skilled attendance at delivery strategy implemented by the Ministry of Health and Family Care International in Ouargaye district (Burkina Faso) from 2002 to 2005. We aimed to evaluate the relationships between accessibility, functioning of health centres and utilisation of delivery care in the SCI intervention district (Ouargaye) and compare this with another district (Diapaga).

METHODS

Data were collected on staffing, equipment, water and energy supply for all health centres and a functionality index for health centres were constructed. A household census was carried out in 2006 to assess assets of all household members, and document pregnancies lasting more than 6 months between 2001 and 2005, with place of delivery and delivery attendant. Utilisation of delivery care was defined as birth in a health institution or birth by Caesarean section. Analyses included univariate and multivariate logistic regression.

RESULTS

Distance to health facility, education and asset ownership were major determinants of delivery care utilisation, but no association was found between the functioning of health centres (as measured by infrastructure, energy supply and equipment) and institutional birth rates or births by Caesarean section. The proportion of births in an institution increased more substantially in the SCI district over time but no changes were seen in Caesarean section rates.

CONCLUSION

The SCI has increased uptake of institutional deliveries but there is little evidence that it has increased access to emergency obstetric care, at least in terms of uptake of Caesarean sections. Its success is contingent on large-scale coverage and 24-h availability of referral for life saving drugs, skilled personnel and surgery for pregnant women.

Evaluating skilled care at delivery in Burkina Faso: principles and practice

There are strong expectations of what could be achieved by skilled care at delivery for maternal and newborn survival and health. Meeting these expectations involves the translation of the concepts and principles of skilled attendance into the reality of routine programmes. This process of translation brings to light some of the tensions which lie behind the consensus on the ideal package and particularly the alternative configurations of provider and place necessary in the immediate term. Lessons learnt from the implementation of specific projects and initiatives have a crucial role to play in informing scaling-up and the achievement of universal coverage. The Skilled Care Initiative implemented in Burkina Faso by Family Care International, evaluated and reported here, provides many lessons for moving from concepts to practice. Firstly, there is the crucial issue of local contextual adaptation, as no one-size-fits-all for skilled attendance. Secondly, interventions to achieve skilled care require and imply different levels of intensity of implementation, depending on the functionality of the wider health system in the intervention area. Thirdly, there is the crucial issue of the balance and sequencing of supply- and demand-side interventions. Finally, the concept of skilled attendance at delivery does not exist in a vacuum in space or time, and concurrent health initiatives and cross-sectoral developments, such as transport and road improvements, can strongly influence outcomes. This not only presents challenges for the implementation of specific interventions within health institutions and communities, but also for the evaluation of their effects.

Effects of a Skilled Care Initiative on pregnancy-related mortality in rural Burkina Faso

OBJECTIVE

The aim of this paper is to assess to what extent a Skilled Care Initiative (SCI) was associated with pregnancy-related mortality in Ouargaye district, Burkina Faso.

METHODS

We used a quasi-experimental design to compare pregnancy-related mortality within the intervention district (health facility areas covered by the SCI vs. areas not covered) and between the intervention district (Ouargaye) and a comparison district (Diapaga). Population-based data were used to examine differences in pregnancy-related mortality levels, their determinants and how they related to uptake of care, as well as examining contexts and mechanisms of pregnancy-related deaths that occurred. Data analyses included descriptive statistics, univariate and multivariate regression analyses.

RESULTS

The main risk factors for pregnancy-related mortality in rural Burkina Faso were age (extreme ages of reproductive period), low coverage of antenatal care and low institutional delivery. The introduction of the SCI, as implemented within the study reference period, had no appreciable effect on pregnancy-related mortality.

CONCLUSION

Although the SCI was conceptually well designed and implemented, structural constraints may have limited its effectiveness for reducing pregnancy-related mortality within its period of implementation. Lessons have been identified which might enable similar skilled attendance strategies to make their full potential impact on pregnancy-related mortality in remote and rural settings.

Undertaking a complex evaluation of safe motherhood in rural Burkina Faso

Evaluations of composite health interventions, such as those attempting to make motherhood safer, are by definition complex, but nevertheless regarded as essential to informing progress in global health. This paper introduces a series of reports which set out the basis of Family Care International's Skilled Care Initiative in rural Burkina Faso, go on to describe strategies and methods for evaluating it, and present evaluation findings in terms of pregnancy outcomes, utilisation and effects of the intervention and economics. Although there were encouraging findings, no 'magic bullets' emerged from these studies, illustrating the reality that sustained and increasing resources are needed to achieve safe motherhood for all. There is no cheap or short-cut solution.

The epidemiology of pregnancy outcomes in rural Burkina Faso

OBJECTIVES

To describe levels and causes of pregnancy-related mortality and selected outcomes after pregnancy (OAP) in two districts of Burkina Faso.

METHODS

A household census was conducted in the two study districts, recording household deaths to women aged 12-49 years from 2001 to 2006. Questions on pregnancy outcomes in the last 5 years for resident women of reproductive age were included, and an additional method - direct sisterhood - was added in part of the area. Adult female deaths were followed-up with verbal autopsies (VA) with household members. A probabilistic model for interpreting VA data (InterVA-M) was used to determine distributions of probable causes of death. An OAP survey was conducted among all women with an experience of pregnancy during the prior 12 months. It aimed to document physical and psychological disabilities, economic and social consequences and discomfort that women may suffer as a result of a pregnancy.

RESULTS

The maternal mortality ratio (MMR) was 441 per 100 000 live births (95% CI: 397, 485), significantly higher in Diapaga [519 per 100 000 (95% CI: 454, 584)] than Ouargaye [353 per 100 000 (95% CI: 295, 411)]. MMRs were associated with wealth quintile, age and distance from a health facility. The causes of death showed higher than expected rates of sepsis (30%) and lower rates of haemorrhage (7%). A substantial proportion of all women had difficulty performing day-to-day tasks as a consequence of pregnancy. Women who had experienced stillbirths or Caesarean sections reported symptom-related indicators of poor physical health more frequently than women reporting uncomplicated deliveries, and were also more likely to be depressed.

CONCLUSIONS

Expectations on the levels and causes of pregnancy-related mortality in Burkina Faso may need to be re-examined, and this could have programmatic implications; for example high levels of sepsis could prompt renewed efforts to reach women with skilled attendance at delivery and follow-up during the postpartum period. Further documentation of how complication-induced disabilities affect women and their families is needed. For mortality and morbidity outcomes, demonstrating variation between study districts is important to empower local decision makers with evidence of need at a subnational level.

Towards reduction of maternal and perinatal mortality in rural Burkina Faso: communities are not empty vessels

BACKGROUND

Reducing maternal and perinatal mortality in sub Saharan Africa remains challenging and requires effective and context specific interventions.

OBJECTIVE

The aims of this paper were to demonstrate the impact of the community mobilisation of the Skilled Care Initiative (SCI) in reducing maternal and perinatal mortality and to describe the concept and implementation in order to guide replication and scaling up.

DESIGNS

A quasi experimental design was used to assess the extent to which the SCI was associated with increased institutional births, maternal and perinatal mortality reduction in an intervention (Ouargaye) versus a comparison (Diapaga) district. A geo-referenced census was conducted to retrospectively assess changes in outcomes and process measures. A detailed description of activities, rationale and timing of implementation were gathered from the SCI project officers and summarised. Data analyses included descriptive statistics and multivariate analyses.

RESULTS

At macro level, the main significant difference between Ouargaye and Diapaga districts was the scope and intensity of the community-based interventions implemented in Ouargaye. There was a temporal association relationship before and after the implementation of the demand-driven interventions and a remarkable 30% increase in institutional births in the intervention district compared to 10% increase in comparison district. There was a significant reduction of perinatal mortality rates (OR =0.75, CI 0.70-0.80) in intervention district and a larger decrease in maternal mortality ratios in intervention district, although statistical significance was not reached. A comprehensive framework of community mobilisation strategy is proposed to improve maternal and child health in poorest communities.

CONCLUSION

Controlling for the availability and quality of health services, working in partnership and effectively with communities, and not for them - hence characterising communities as not being empty vessels - can have impacts on outcomes. Here, in the district with a community mobilisation programme, there was a marked increase in institutional births and reductions in maternal and perinatal deaths.

Population survey sampling methods in a rural African setting: measuring mortality

Background

Population-based sample surveys and sentinel surveillance methods are commonly used as substitutes for more widespread health and demographic monitoring and intervention studies in resource-poor settings. Such methods have been criticised as only being worthwhile if the results can be extrapolated to the surrounding 100-fold population. With an emphasis on measuring mortality, this study explores the extent to which choice of sampling method affects the representativeness of 1% sample data in relation to various demographic and health parameters in a rural, developing-country setting.

Methods

Data from a large community based census and health survey conducted in rural Burkina Faso were used as a basis for modelling. Twenty 1% samples incorporating a range of health and demographic parameters were drawn at random from the overall dataset for each of seven different sampling procedures at two different levels of local administrative units. Each sample was compared with the overall 'gold standard' survey results, thus enabling comparisons between the different sampling procedures.

Results

All sampling methods and parameters tested performed reasonably well in representing the overall population. Nevertheless, a degree of variation could be observed both between sampling approaches and between different parameters, relating to their overall distribution in the total population.

Conclusion

Sample surveys are able to provide useful demographic and health profiles of local populations. However, various parameters being measured and their distribution within the sampling unit of interest may not all be best represented by a particular sampling method. It is likely therefore that compromises may have to be made in choosing a sampling strategy, with costs, logistics the intended use of the data being important considerations.