The role of integrated community case management projects in strengthening health systems: case study analysis in Ethiopia, Malawi and Mozambique

Effective coverage of curative child health services in Ethiopia: analysis of the Demographic and Health Survey and Service Provision Assessment survey

OBJECTIVES

Despite a remarkable decline, childhood morbidity and mortality in Ethiopia remain high and inequitable. Thus, we estimated the effective coverage of curative child health services in Ethiopia.

DESIGN

We conducted a cross-sectional analysis of data from the 2016 Ethiopia Demographic and Health Survey (DHS) and the 2014 Ethiopia Service Provision Assessment Plus (SPA+) survey.

SETTING

Nationally representative household and facility surveys.

PARTICIPANTS AND OUTCOMES

We included a sample of 2096 children under 5 years old (from DHS) who had symptoms of one or more common childhood illnesses (diarrhoea, fever and acute respiratory infection) and estimated the percentage of sick children who were taken to a health facility (crude coverage). To construct a quality index of child health services, we used the SPA+ survey, which was conducted in 1076 health facilities and included observations of care for 1980 sick children and surveys of 1908 mothers/caregivers and 5328 health providers. We applied the Donabedian quality of care framework to identify 58 quality parameters (structure, 31; process, 16; and outcome, 11) and used the weighted additive method to estimate the overall quality of care index. Finally, we multiplied the crude coverage by the quality of care index to estimate the effective coverage of curative child health services, nationally and by region.

RESULTS

Among the 2096 sick children, only 38.4% (95% CI: 36.5 to 40.4) of them were taken to a health facility. The overall quality of care was 54.4%, weighted from structure (30.0%), process (9.2%) and outcome (15.2%). The effective coverage of curative child health services was estimated at 20.9% (95%CI: 19.9 to 22.0) nationally, ranging from 16.9% in Somali to 34.6% in Dire Dawa regions.

CONCLUSIONS

System-wide interventions are required to address both demand-side and supply-side bottlenecks in the provision of child health services if child health-related targets are to be achieved in Ethiopia.

How do we design and evaluate health system strengthening? Collaborative development of a set of health system process goals

Strong health systems are widely recognized as a key requirement for improving health outcomes and also for ensuring that health systems are equitable, resilient and responsive to population needs. However, the related term Health Systems Strengthening (HSS) remains unclear and contested, and this creates challenges for how HSS can be monitored and evaluated. A previous review argued for the need to rethink evaluation methods for HSS to examine systemic effects of HSS investments. In line with that recommendation, this article describes the work of the HSS Evaluation Collaborative (HSSEC) in the development of a framework and tool to guide HSS monitoring, evaluation and learning by national and global actors. It was developed based on a rapid review of the literature and iterative expert consultation, with the aim of going beyond a focus on the building blocks of health systems and on health system outputs or health outcomes to think about the features that constitute a strong health system. As a result, we developed a list of 22 health system process goals which represent desirable attributes for health systems. The health system process goals (or rather, progress towards them) are influenced by positive and negative, intended and unintended effects of HSS interventions. Finally, we illustrate how the health system process goals can be operationalised for prospective and retrospective HSS monitoring, evaluation and learning, and how they also have the potential to be used for opening a space for participatory, inclusive policy dialogue about HSS.

On Learning About Efforts to Strengthen (and Reduce Harm to) Systems for Health

We comment on two embedded case studies of systems effects of successive mid-size projects looking back over 7-10 years, published in Health Policy and Planning. The papers examine humanitarian projects in Sudan and Pakistan and development projects (integrated Community Case Management) in Ethiopia, Malawi, and Mozambique. In this commentary, we summarize the two papers and discuss the overarching substantive and methodological lessons learned. In both development and humanitarian/emergency practice, projects navigate a dynamic space between gap-filling, systems support, and systems strengthening. In this, their contribution to systems strengthening depends heavily on the eco-system of government, development partners, and donors. Systems strengthening presents great challenges in definition, implementation, and measurement. Nonetheless, project implementers can and should renew their commitment to strengthening systems for health. This comes with a fundamental requirement for learning and evaluation.