National Assessment of Data Quality and Associated Systems-Level Factors in Malawi

BACKGROUND

Routine health data can guide health systems improvements, but poor quality of these data hinders use. To address concerns about data quality in Malawi, the Ministry of Health and National Statistical Office conducted a data quality assessment (DQA) in July 2016 to identify systems-level factors that could be improved.

METHODS

We used 2-stage stratified random sampling methods to select health centers and hospitals under Ministry of Health auspices, included those managed by faith-based entities, for this DQA. Dispensaries, village clinics, police and military facilities, tertiary-level hospitals, and private facilities were excluded. We reviewed client registers and monthly reports to verify availability, completeness, and accuracy of data in 4 service areas: antenatal care (ANC), family planning, HIV testing and counseling, and acute respiratory infection (ARI). We also conducted interviews with facility and district personnel to assess health management information system (HMIS) functioning and systems-level factors that may be associated with data quality. We compared systems and quality factors by facility characteristics using 2-sample t tests with Welch's approximation, and calculated verification ratios comparing total entries in registers to totals from summarized reports.

RESULTS

We selected 16 hospitals (of 113 total in Malawi), 90 health centers (of 466), and 16 district health offices (of 28) in 16 of Malawi's 28 districts. Nearly all registers were available and complete in health centers and district hospitals, but data quality varied across service areas; median verification ratios comparing register and report totals at health centers ranged from 0.78 (interquartile range [IQR]: 0.25, 1.07) for ARI and 0.99 (IQR: 0.82, 1.36) for family planning to 1.00 (IQR: 0.96, 1.00) for HIV testing and counseling and 1.00 (IQR: 0.80, 1.23) for ANC. More than half (60%) of facilities reported receiving a documented supervisory visit for HMIS in the prior 6 months. A recent supervision visit was associated with better availability of data (P=.05), but regular district- or central-level supervision was not. Use of data by the facility to track performance toward targets was associated with both improved availability (P=.04) and completeness of data (P=.02). Half of facilities had a full-time statistical clerk, but their presence did not improve the availability or completeness of data (P=.39 and P=.69, respectively).

CONCLUSION

Findings indicate both strengths and weaknesses in Malawi's HMIS performance, with key weaknesses including infrequent data quality checks and unreliable supervision. Efforts to strengthen HMIS in low- and middle-income countries should be informed by similar assessments.

Social autopsy of neonatal mortality suggests needed improvements in maternal and neonatal interventions in Balaka and Salima districts of Malawi

Background

The Every Newborn Action Plan calls for reducing the neonatal mortality rates to fewer than 10 deaths per 1000 live births in all countries by 2035. The current study aims to increase our understanding of the social and modifiable factors that can be addressed or reinforced to improve and accelerate the decline in neonatal mortality in Malawi.

Methods

The data come from the 2013 Verbal and Social Autopsy (VASA) study that collected data in order to describe the biological causes and the social determinants of deaths of children under 5 years of age in Balaka and Salima districts of Malawi. This paper analyses the social autopsy data of the neonatal deaths and presents results of a review of the coverage of key interventions along the continuum of normal maternal and newborn care and the description of breakdowns in the care provided for neonatal illnesses within the Pathway to Survival framework.

Results

A total of 320 neonatal deaths were confirmed from the VASA survey. While one antenatal care (ANC) visit was high at 94%, the recommended four ANC visits was much lower at 41% and just 17% of the mothers had their urines tested during the pregnancy. 173 (54%) mothers of the deceased newborns had at least one labor/delivery complication that began at home. The caregivers of 65% (n = 75) of the 180 newborns that were born at home or born and left a health facility alive perceived them to be severely ill at the onset of their illness, yet only 44% (n = 80) attempted and 36% (n = 65)could reach the first health provider after an average of 91 minutes travel time. Distance, lack of transport and cost emerged as the most important constraints to formal care–seeking during delivery and during the newborn fatal illness.

Conclusions

This study suggests that maternal and neonatal health organizations and the local government of Malawi should increase the demand for key maternal and child health interventions, including the recommended 4 ANC visits, and ensure urine screening for all pregnant women. Early recognition and referrals of women with obstetric complications and interventions to promote maternal recognition of neonatal illnesses and care–seeking before the child becomes severely ill are also needed to improve newborn survival in Balaka and Salima districts of Malawi.

Malawi and Millennium Development Goal 4: a Countdown to 2015 country case study

BACKGROUND

Several years in advance of the 2015 endpoint for the Millennium Development Goals (MDGs), Malawi was already thought to be one of the few countries in sub-Saharan Africa likely to meet the MDG 4 target of reducing under-5 mortality by two-thirds between 1990 and 2015. Countdown to 2015 therefore selected the Malawi National Statistical Office to lead an in-depth country case study, aimed mainly at explaining the country's success in improving child survival.

METHODS

We estimated child and neonatal mortality for the years 2000-14 using five district-representative household surveys. The study included recalculation of coverage indicators for that period, and used the Lives Saved Tool (LiST) to attribute the child lives saved in the years from 2000 to 2013 to various interventions. We documented the adoption and implementation of policies and programmes affecting the health of women and children, and developed estimates of financing.

FINDINGS

The estimated mortality rate in children younger than 5 years declined substantially in the study period, from 247 deaths (90% CI 234-262) per 1000 livebirths in 1990 to 71 deaths (58-83) in 2013, with an annual rate of decline of 5·4%. The most rapid mortality decline occurred in the 1-59 months age group; neonatal mortality declined more slowly (from 50 to 23 deaths per 1000 livebirths), representing an annual rate of decline of 3·3%. Nearly half of the coverage indicators have increased by more than 20 percentage points between 2000 and 2014. Results from the LiST analysis show that about 280,000 children's lives were saved between 2000 and 2013, attributable to interventions including treatment for diarrhoea, pneumonia, and malaria (23%), insecticide-treated bednets (20%), vaccines (17%), reductions in wasting (11%) and stunting (9%), facility birth care (7%), and prevention and treatment of HIV (7%). The amount of funding allocated to the health sector has increased substantially, particularly to child health and HIV and from external sources, but remains below internationally agreed targets. Key policies to address the major causes of child mortality and deliver high-impact interventions at scale throughout Malawi began in the late 1990s and intensified in the latter half of the 2000s and into the 2010s, backed by health-sector-wide policies to improve women's and children's health.

INTERPRETATION

This case study confirmed that Malawi had achieved MDG 4 for child survival by 2013. Our findings suggest that this was achieved mainly through the scale-up of interventions that are effective against the major causes of child deaths (malaria, pneumonia, and diarrhoea), programmes to reduce child undernutrition and mother-to-child transmission of HIV, and some improvements in the quality of care provided around birth. The Government of Malawi was among the first in sub-Saharan Africa to adopt evidence-based policies and implement programmes at scale to prevent unnecessary child deaths. Much remains to be done, building on this success and extending it to higher proportions of the population and targeting continued high neonatal mortality rates.

FUNDING

Bill & Melinda Gates Foundation, WHO, The World Bank, Government of Australia, Government of Canada, Government of Norway, Government of Sweden, Government of the UK, and UNICEF.

Independent Evaluation of the integrated Community Case Management of Childhood Illness Strategy in Malawi Using a National Evaluation Platform Design

We evaluated the impact of integrated community case management of childhood illness (iCCM) on careseeking for childhood illness and child mortality in Malawi, using a National Evaluation Platform dose-response design with 27 districts as units of analysis. “Dose” variables included density of iCCM providers, drug availability, and supervision, measured through a cross-sectional cellular telephone survey of all iCCM-trained providers. “Response” variables were changes between 2010 and 2014 in careseeking and mortality in children aged 2–59 months, measured through household surveys. iCCM implementation strength was not associated with changes in careseeking or mortality. There were fewer than one iCCM-ready provider per 1,000 under-five children per district. About 70% of sick children were taken outside the home for care in both 2010 and 2014. Careseeking from iCCM providers increased over time from about 2% to 10%; careseeking from other providers fell by a similar amount. Likely contributors to the failure to find impact include low density of iCCM providers, geographic targeting of iCCM to “hard-to-reach” areas although women did not identify distance from a provider as a barrier to health care, and displacement of facility careseeking by iCCM careseeking. This suggests that targeting iCCM solely based on geographic barriers may need to be reconsidered.

Measuring Implementation Strength for Integrated Community Case Management in Malawi: Results from a National Cell Phone Census

Program managers, investors, and evaluators need real-time information on how program strategies are being scaled up and implemented. Integrated Community Case Management (iCCM) of childhood illnesses is a strategy for increasing access to diagnosis and treatment of malaria, pneumonia, and diarrhea through community-based health workers. We collected real-time data on iCCM implementation strength through cell phone interviews with community-based health workers in Malawi and calculated indicators of implementation strength and utilization at district level using consensus definitions from the Ministry of Health (MOH) and iCCM partners. All of the iCCM implementation strength indicators varied widely within and across districts. Results show that Malawi has made substantial progress in the scale-up of iCCM since the 2008 program launch. However, there are wide differences in iCCM implementation strength by district. Districts that performed well according to the survey measures demonstrate that MOH implementation strength targets are achievable with the right combination of supportive structures. Using the survey results, specific districts can now be targeted with additional support.