Evidence of Impact: iCCM as a strategy to save lives of children under five

Background

In 2013, the World Health Organization (WHO) launched the Rapid Access Expansion (RAcE) programme in the Democratic Republic of Congo, Malawi, Mozambique, Niger, and Nigeria to increase coverage of diagnostic, treatment, and referral services for malaria, pneumonia, and diarrhea among children ages 2-59 months. In 2017, a final evaluation of the six RAcE sites was conducted to determine whether the programme goal was reached. A key evaluation objective was to estimate the reduction in childhood mortality and the number of under-five lives saved over the project period in the RAcE project areas.

Methods

The Lives Saved Tool (LiST) was used to estimate reductions in all-cause child mortality due to changes in coverage of treatment for the integrated community case management (iCCM) illnesses – malaria, pneumonia, and diarrhea – while accounting for other changes in maternal and child health interventions in each RAcE project area. Data from RAcE baseline and endline household surveys, Demographic and Health Surveys, and routine health service data were used in each LiST model. The models yielded estimated change in under-five mortality rates, and estimated number of lives saved per year by malaria, pneumonia and diarrhea treatment. We adjusted the results to estimate the number of lives saved by community health worker (CHW)-provided treatment.

Results

The LiST model accounts for coverage changes in iCCM intervention coverage and other health trends in each project area to estimate mortality reduction and child lives saved. Under five mortality declined in all six RAcE sites, with an average decline of 10 percent. An estimated 6200 under-five lives were saved by malaria, pneumonia, and diarrhea treatment in the DRC, Malawi, Niger, and Nigeria, of which approximately 4940 (75 percent) were saved by treatment provided by CHWs. This total excludes Mozambique, where there were no estimated under-five lives saved likely due to widespread stockouts of key medications. In all other project areas, lives saved by CHW-provided treatment contributed substantially to the estimated decline in under-five mortality.

Conclusions

Our results suggest that iCCM is a strategy that can save lives and measurably decrease child mortality in settings where access to health facility services is low and adequate resources for iCCM implementation are provided for CHW services.

Achievements and challenges of implementation in a mature iCCM programme: Malawi case study

Background

Malawi has a mature integrated community case management (iCCM) programme that is led by the Ministry of Health (MOH) but that still relies on donor support. From 2013 until 2017, under the Rapid Access Expansion (RAcE) programme, the World Health Organization supported the MOH to expand and strengthen iCCM services in four districts. This paper examines Malawi’s iCCM programme performance and implementation strength in RAcE districts to further strengthen the broader programme.

Methods

Baseline and endline household surveys were conducted in iCCM-eligible areas of RAcE districts. Primary caregivers of recently-sick children under five were interviewed to assess changes in care-seeking and treatment over the project period. Health surveillance assistants (HSAs) were surveyed at endline to assess iCCM implementation strength.

Results

Care-seeking from HSAs and treatment of fever improved over the project period. At endline, however, less than half of sick children were brought to an HSA, many caregivers reported a preference for providers other than HSAs, and perceptions of HSAs as trusted providers of high-quality, convenient care had decreased. HSA supervision and mentorship were below MOH targets. Stockouts of malaria medicines were associated with decreased care-seeking from HSAs. Thirty percent of clusters had limited or no access to iCCM (no HSA or an HSA providing iCCM services less than 2 days per week); 50% had moderate access (an HSA providing iCCM services 2 to 4 days per week; and 20% had high access (a resident HSA providing iCCM services 5 or more days per week). Moderate access to iCCM was associated with increased care-seeking from HSAs, increased treatment by HSAs, and more positive perceptions of HSAs compared to areas with limited or no access. Areas with high access to iCCM did not show further improvements above areas with moderate access.

Conclusions

Availability of well-equipped and supported HSAs is critical to the provision of iCCM services. Additional qualitative research is needed to examine challenges and to inform potential solutions. Malawi’s mature iCCM programme has a strong foundation but can be improved to strengthen the continuity of care from communities to facilities and to ultimately improve child health outcomes.

iCCM data quality: an approach to assessing iCCM reporting systems and data quality in 5 African countries

BACKGROUND

Ensuring the quality of health service data is critical for data-driven decision-making. Data quality assessments (DQAs) are used to determine if data are of sufficient quality to support their intended use. However, guidance on how to conduct DQAs specifically for community-based interventions, such as integrated community case management (iCCM) programs, is limited. As part of the World Health Organization's (WHO) Rapid Access Expansion (RAcE) Programme, ICF conducted DQAs in a unique effort to characterize the quality of community health worker-generated data and to use DQA findings to strengthen reporting systems and decision-making.

METHODS

We present our experience implementing assessments using standardized DQA tools in the six RAcE project sites in the Democratic Republic of Congo, Malawi, Mozambique, Niger, and Nigeria. We describe the process used to create the RAcE DQA tools, adapt the tools to country contexts, and develop the iCCM DQA Toolkit, which enables countries to carry out regular and rapid DQAs. We provide examples of how we used results to generate recommendations.

RESULTS

The DQA tools were customized for each RAcE project to assess the iCCM data reporting system, trace iCCM indicators through this system, and to ensure that DQAs were efficient and generated useful recommendations. This experience led to creation of an iCCM DQA Toolkit comprised of simplified versions of RAcE DQA tools and a guidance document. It includes system assessment questions that elicit actionable responses and a simplified data tracing tool focused on one treatment indicator for each iCCM focus illness: diarrhea, malaria, and pneumonia. The toolkit is intended for use at the national or sub-national level for periodic data quality checks.

CONCLUSIONS

The iCCM DQA Toolkit was designed to be easily tailored to different data reporting system structures because iCCM data reporting tools and data flow vary substantially. The toolkit enables countries to identify points in the reporting system where data quality is compromised and areas of the reporting system that require strengthening, so that countries can make informed adjustments that improve data quality, strengthen reporting systems, and inform decision-making.

Caregiver exposure to malaria social and behaviour change messages can improve bed net use among children in an endemic country: secondary analysis of the 2015 Nigeria Malaria Indicator Survey

Background

To reduce the malaria burden in Nigeria, the National Malaria Strategic Plan (NMSP) 2014‒2020 calls for the scale-up of prevention and treatment interventions, including social and behaviour change (SBC). SBC interventions can increase awareness and improve the demand for and uptake of malaria interventions. However, there is limited evidence supporting the implementation of SBC interventions to improve key malaria behaviours, such as insecticide-treated bed net (ITN) use, among children in Nigeria.

Methods

Using data from 2015 Nigeria Malaria Indicator Survey, this study used multiple logistic regression to assess the relationship between caregiver exposure to malaria messages and ITN use among children under five.

Results

Caregiver exposure to ITN-related messages was significantly associated with ITN use among children under five (odds ratio [OR] = 1.63, p < 0.001).

Conclusions

The results suggest that caregiver exposure to topic-specific SBC messages improves the use of ITNs among children. Given these results, Nigeria should strive to scale up SBC interventions to help increase ITN use among children in line with the objectives of the NMSP. Further evidence is needed to determine which SBC interventions are the most effective and scalable in Nigeria.

Assessment of data quality and reporting systems for underserved populations: the case of integrated community case management programs in Nigeria

Decision makers are searching for reliable data and best practices to support the implementation and scale-up of the integrated community case management (iCCM) programs in underserved areas to reduce under-five mortality in low-income countries. This study assesses data quality and reporting systems of the World Health Organization supported Rapid Access Expansion program implementing iCCM in Abia and Niger States, Nigeria. This cross-sectional study used data from 16 primary health facilities in both states. Data were collected through review of registers and monthly summary reports of 140 community-oriented resource persons (CORPs), assessments of the five dimensions of the data reporting systems and 46 key informant interviews with stakeholders. Data quality was assessed by availability, completeness and consistency. Each component of the reporting system was assessed on a 3-point scale (weak, satisfactory and strong). Results show that both the structure, functions and capabilities, as well as data collection and reporting tools dimensions of the reporting system were strong, scoring (2.80, 2.73) for Abia and (2.88, 2.75) for Niger, respectively. Data management processes and links with national reporting system components scored low 2 s, indicating fair strength. Data availability, completeness and consistency were found to be good, an indication of adequate training and supervision of CORPs and community health extension workers. Indicator definitions and reporting guidelines were the weakest dimension of the system due to lack of data reporting guidelines in both states. In conclusion, the results indicate satisfactory data reporting systems and good quality data during early implementation of iCCM programs in the two states. Hence, countries planning to adopt and implement iCCM programs should first develop structures, establish national standardized tools for collecting and reporting data, provide for adequate training and supervision of community health workers and develop reporting guidelines for all reporting levels to ensure data quality.

How do we know? An assessment of integrated community case management data quality in four districts of Malawi

The World Health Organization contracted annual data quality assessments of Rapid Access Expansion (RAcE) projects to review integrated community case management (iCCM) data quality and the monitoring and evaluation (M&E) system for iCCM, and to suggest ways to improve data quality. The first RAcE data quality assessment was conducted in Malawi in January 2014 and we present findings pertaining to data from the health management information system at the community, facility and other sub-national levels because RAcE grantees rely on that for most of their monitoring data. We randomly selected 10 health facilities (10% of eligible facilities) from the four RAcE project districts, and collected quantitative data with an adapted and comprehensive tool that included an assessment of Malawi's M&E system for iCCM data and a data verification exercise that traced selected indicators through the reporting system. We rated the iCCM M&E system across five function areas based on interviews and observations, and calculated verification ratios for each data reporting level. We also conducted key informant interviews with Health Surveillance Assistants and facility, district and central Ministry of Health staff. Scores show a high-functioning M&E system for iCCM with some deficiencies in data management processes. The system lacks quality controls, including data entry verification, a protocol for addressing errors, and written procedures for data collection, entry, analysis and management. Data availability was generally high except for supervision data. The data verification process identified gaps in completeness and consistency, particularly in Health Surveillance Assistants' record keeping. Staff at all levels would like more training in data management. This data quality assessment illuminates where an otherwise strong M&E system for iCCM fails to ensure some aspects of data quality. Prioritizing data management with documented protocols, additional training and approaches to create efficient supervision practices may improve iCCM data quality.