Monitoring Results in Routine Immunization: Development of Routine Immunization Dashboard in Selected African Countries in the Context of the Polio Eradication Endgame Strategic Plan

Lessons from polio eradication: a synthesis of implementation strategies for global health services delivery from a scoping review

Introduction

There is limited guidance on strategies for delivering complex global health programs. We synthesized available evidence on implementation strategies and outcomes utilized in the global polio eradication initiative (GPEI) across low and middle-income country (LMIC) settings.

Methods

We nested our scoping review into a literature review conducted as part of a parent study, STRIPE. This review systematically searched PubMed for articles between 1 January 1988 and 25 April 2018 using polio search terms. Strategies from included studies were organized according to the Expert Recommendations for Implementing Change (ERIC) framework, specified using Proctor's framework, and linked to various outcomes (implementation, services delivery, impact).

Results

152 unique articles fulfilled our inclusion criteria (from 1,885 articles included in the parent study). Only 43 out of the 152 articles described a suitable quantitative study design for evaluating outcomes. We extracted 66 outcomes from the 43 unique studies. Study publication dates ranged from 1989 to 2018 and represented diverse country settings. The most common implementation strategies were developing mechanisms for feedback, monitoring, and evaluation (n = 69); increasing awareness among the population (n = 58); involving stakeholders, workers, and consumers in the implementation efforts (n = 46); conducting workshops (n = 33); using mass media (n = 31); and building robust record systems to capture outcomes (n = 31). Coverage (n = 13) and morbidity (n = 12) were the most frequently identified outcomes, followed by effectiveness (n = 9) and fidelity (n = 6). Feasibility and sustainability were rarely evaluated.

Conclusions

This review provides a catalogue of implementation strategies and outcomes relevant for advancing global health services delivery in LMICs drawing from the GPEI. Implementation strategies reviewed were poorly described and not adequately linked to outcomes. It calls for additional implementation research to unravel the mechanisms of implementation strategies and their effectiveness, and adaptation of the ERIC framework in LMICs.

Do vaccines increase or decrease susceptibility to diseases other than those they protect against?

Contrary to the long-held belief that the effects of vaccines are specific for the disease they were created; compelling evidence has demonstrated that vaccines can exert positive or deleterious non-specific effects (NSEs). In this review, we compiled research reports from the last 40 years, which were found based on the PubMed search for the epidemiological and immunological studies on the non-specific effects (NSEs) of the most common human vaccines. Analysis of information showed that live vaccines induce positive NSEs, whereas non-live vaccines induce several negative NSEs, including increased female mortality associated with enhanced susceptibility to other infectious diseases, especially in developing countries. These negative NSEs are determined by the vaccination sequence, the antigen concentration in vaccines, the type of vaccine used (live vs. non-live), and also by repeated vaccination. We do not recommend stopping using non-live vaccines, as they have demonstrated to protect against their target disease, so the suggestion is that their detrimental NSEs can be minimized simply by changing the current vaccination sequence. High IgG4 antibody levels generated in response to repeated inoculation with mRNA COVID-19 vaccines could be associated with a higher mortality rate from unrelated diseases and infections by suppressing the immune system. Since most COVID-19 vaccinated countries are reporting high percentages of excess mortality not directly attributable to deaths from such disease, the NSEs of mRNA vaccines on overall mortality should be studied in depth.

Measuring National Immunization System Performance: A Systematic Assessment of Available Resources

BACKGROUND

Vaccination coverage is widely used to assess immunization performance but, on its own, provides insufficient information to drive improvements. Assessing the performance of underlying components of immunization systems is less clear, with several monitoring and evaluation (M&E) resources available for use in different operational settings and for different purposes. We studied these resources to understand how immunization system performance is measured.

METHODS

We reviewed peer-reviewed and gray literature published since 2000 to identify M&E resources that include national-level indicators measuring the performance of immunization systems or their components (governance, financing, regulation, information systems, vaccine logistics, workforce, service delivery, and demand generation). We summarize indicators by the system components or outcomes measured and describe findings narratively.

RESULTS

We identified 20 resources to monitor immunization program objectives and guide national strategic decision-making, encompassing 631 distinct indicators. Indicators for immunization program outcomes comprised the majority (124/631 [19.7%]), largely vaccination coverage (110/124 [88.7%]). Almost all resources (19/20 [95%]) included indicators for vaccine logistics (83/631 [13.2%]), and those for regulation (19/631 [3.0%]) and demand generation (28/631 [4.4%]) were least common. There was heterogeneity in how information systems (92/563 [14.6%]) and workforce (47/631 [7.4%]) were assessed across resources. Indicators for vaccination coverage in adults, data use in decision-making, equity and diversity, effectiveness of safety surveillance, and availability of a public health workforce were notably lacking.

CONCLUSIONS

Between the resources identified in this review, we identified considerable variability and gaps in indicators assessing the performance of some immunization system components. Given the multitude of indicators, policymakers may be better served by tailoring evaluation resources to their specific context to gain useful insight into health system performance and improve data use in decision-making for immunization programs.

Planning for supplemental immunization activities using the readiness assessment dashboard: Experience from 2017/2018 Measles vaccination campaign, Nigeria

INTRODUCTION

Globally, supplemental immunization activities (SIAs) are known to be a major strategy for attainment of the global measles elimination goal of less than one measles case per million population within a geographic area by the year 2020. Adequate planning is critical to the success of a vaccination campaign. To achieve a quality SIA implementation for effective interruption of measles transmission, the World Health Organization introduced the SIA Readiness Assessment Tool, which includes the readiness dashboard. It is a strategic planning tool used to ensure critical activities are completed before SIAs. Nigeria implemented a phased measles SIA in 2017/2018 and used the readiness assessment tool in the planning for the campaign. In this article, we report the use of the readiness assessment dashboard in the 2017/2018 measles SIA, we also reviewed its contributions to the outcome of the campaign looking at the post campaign coverage survey results for the states.

METHODS

We conducted a retrospective review of the readiness assessment dashboard used during the 2017/2018 measles vaccination campaign in Nigeria. The readiness dashboard tool was designed using Microsoft Excel 2016. We reported results in frequencies and proportions using charts and tables.

RESULTS

The states with 100% readiness a week prior to the campaign scored a post campaign coverage survey result of 84.6 - 96.5% with just one out of the eight states in this category getting a score below 90%. In the same vein, of the eight states that their readiness score at one week to the campaign was below 85%, six had post campaign coverage survey score of less than 90% with the highest score in this category being 92.3%. Some states with good readiness scores also had poor post campaign coverage survey which has been attributed to other factors other than readiness.

CONCLUSION

The readiness assessment dashboard for the measles vaccination campaign provided a platform for tracking states readiness. It is our view that a link between readiness assessment and coverage should be examined in future studies.

A realist systematic review of evidence from low- and middle-income countries of interventions to improve immunization data use

BACKGROUND

The use of routine immunization data by health care professionals in low- and middle-income countries remains an underutilized resource in decision-making. Despite the significant resources invested in developing national health information systems, systematic reviews of the effectiveness of data use interventions are lacking. Applying a realist review methodology, this study synthesized evidence of effective interventions for improving data use in decision-making.

METHODS

We searched PubMed, POPLINE, Centre for Agriculture and Biosciences International Global Health, and African Journals Online for published literature. Grey literature was obtained from conference, implementer, and technical agency websites and requested from implementing organizations. Articles were included if they reported on an intervention designed to improve routine data use or reported outcomes related to data use, and targeted health care professionals as the principal data users. We developed a theory of change a priori for how we expect data use interventions to influence data use. Evidence was then synthesized according to data use intervention type and level of the health system targeted by the intervention.

RESULTS

The searches yielded 549 articles, of which 102 met our inclusion criteria, including 49 from peer-reviewed journals and 53 from grey literature. A total of 66 articles reported on immunization data use interventions and 36 articles reported on data use interventions for other health sectors. We categorized 68 articles as research evidence and 34 articles as promising strategies. We identified ten primary intervention categories, including electronic immunization registries, which were the most reported intervention type (n = 14). Among the research evidence from the immunization sector, 32 articles reported intermediate outcomes related to data quality and availability, data analysis, synthesis, interpretation, and review. Seventeen articles reported data-informed decision-making as an intervention outcome, which could be explained by the lack of consensus around how to define and measure data use.

CONCLUSIONS

Few immunization data use interventions have been rigorously studied or evaluated. The review highlights gaps in the evidence base, which future research and better measures for assessing data use should attempt to address.

Geographic location of health facility and immunization program performance in Hoima district, western Uganda: a health facility level assessment

Background

Globally, immunization coverage for childhood vaccines is below the immunization target of achieving at least 90% coverage with the pentavalent vaccine. In Uganda, a recent survey shows 80% of districts had poor immunization program performance. However, there is significant variation in performance within and between districts. We hypothesized that geographic location of a health facility may influence performance of its immunization programs. Therefore, the purpose of this study was to examine whether geographical location of a health facility within a district is associated with performance of the immunization program in Hoima district, western Uganda.

Methods

We conducted a cross sectional study using a mixed methods approach. The main study unit was a health center and we also interviewed health workers in-charge of the facilities and reviewed their health facility records. We reviewed the Uganda Health Management Information System (HMIS) 105 reports of six months to obtain data on immunization program performance. Performance was categorized using World Health Organization’s Reach Every District (RED) criteria and classified as poor if a facility fell in category 3 or 4 and good if 1 or 2. We also conducted key informant interviews with immunization focal persons in the district. We examined the association between dependent and independent variables using Fisher’s exact test.

Results

We collected data at 49 health facilities. Most of these facilities (55.1%) had poor immunization program performance. Proximal location to the central district headquarters was significantly associated with poor immunization program performance (p < 0.05). Attitudes of health workers in the more urban areas, differences in strategies for outreach site selection and community mobilization in the rural and urban areas were suggested as possible explanations.

Conclusions

Proximal location to the urban setting near district headquarters was strongly associated with poor immunization program performance. To be able to reach larger numbers of children for vaccination, interventions to improve performance should target health facilities in urban settings.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-020-09859-z.

Diphtheria-Tetanus-Pertussis (DTP) Vaccine Is Associated With Increased female-Male Mortality. Studies of DTP administered before and after measles vaccine

Background

The third dose of diphtheria-tetanus-pertussis vaccine (DTP3) is used to monitor immunization programs. DTP has been associated with higher female mortality.

Methods

We updated previous literature searches for DTP studies of mortality by sex. We examined the female/male (F/M) mortality rate ratio (MRR) with increasing number of doses of DTP and for subsequent doses of measles vaccine (MV) after DTP and of DTP after MV.

Results

Eight studies had information on both DTP1 and DTP3. The F/M MRR was 1.17 (95% confidence interval [CI], .88–1.57) after DTP1 and increased to 1.66 (95% CI, 1.32–2.09) after DTP3. Following receipt of MV, the F/M MRR declined to 0.63 (95% CI, .42–.96). In 11 studies the F/M MRR increased to 1.73 (95% CI, 1.33–2.27) when DTP-containing vaccine was administered after MV.

Conclusions

F/M MRR increased with increasing doses of DTP. After MV, girls had lower mortality than boys. With DTP after MV, mortality increased again for girls relative to boys. No bias can explain these changes in F/M MRR. DTP does not improve male survival substantially in situations with herd immunity to pertussis and higher F/M MRR after DTP may therefore reflects an absolute increase in female mortality.

Improving the quality and use of immunization and surveillance data: Summary report of the Working Group of the Strategic Advisory Group of Experts on Immunization

Concerns about the quality and use of immunization and vaccine-preventable disease (VPD) surveillance data have been highlighted on the global agenda for over two decades. In August 2017, the Strategic Advisory Group of Experts (SAGE) established a Working Group (WG) onthe Quality and Use of Global Immunization and Surveillance Data to review the current status and evidence to make recommendations, which were presented to SAGE in October 2019. The WG synthesized evidence from landscape analyses, literature reviews, country case-studies, a data triangulation analysis, as well as surveys of experts. Data quality (DQ) was defined as data that are accurate, precise, relevant, complete, and timely enough for the intended purpose (fit-for-purpose), and data use as the degree to which data are actually used for defined purposes, e.g., immunization programme management, performance monitoring, decision-making. The WG outlined roles and responsibilities for immunization and surveillance DQ and use by programme level. The WG found that while DQ is dependent on quality data collection at health facilities, many interventions have targeted national and subnational levels, or have focused on new technologies, rather than the people and enabling environments required for functional information systems. The WG concluded that sustainable improvements in immunization and surveillance DQ and use will require efforts across the health system - governance, people, tools, and processes, including use of data for continuous quality improvement (CQI) - and that the approaches need to be context-specific, country-owned and driven from the frontline up. At the country level, major efforts are needed to: (1) embed monitoring DQ and use alongside monitoring of immunization and surveillance performance, (2) increase workforce capacity and capability for DQ and use, starting at the facility level, (3) improve the accuracy of immunization programme targets (denominators), (4) enhance use of existing data for tailored programme action (e.g., immunization programme planning, management and policy-change), (5) adopt a data-driven CQI approach as part of health system strengthening, (6) strengthen governance around piloting and implementation of new information and communication technology tools, and (7) improve data sharing and knowledge management across areas and organizations for improved transparency and efficiency. Global and regional partners are requested to support countries in adopting relevant recommendations for their setting and to continue strengthening the reporting and monitoring of immunization and VPD surveillance data through processes periodic needs assessment and revision processes. This summary of the WG's findings and recommendations can support "data-guided" implementation of the new Immunization Agenda 2030.

Potency of the Sabin inactivated poliovirus vaccine (sIPV) after exposure to freezing temperatures in cold chains

With more demand for Sabin inactivated poliovirus vaccines (sIPVs) to support the global polio eradication effort worldwide, data regarding the potency characteristics of sIPV after exposure to freezing temperatures are urgently required. In the present study, the sIPVs were stored at -20°C for 24 h, 1 week, and 2 weeks in the freezer or in a vaccine carrier for 1 or 3 freeze-thaw cycle to evaluate the effect mediated by freezing temperatures that may be encountered during routine storage and transfer. The in vitro potency was then determined by a D-antigen enzyme-linked immunosorbent assay, and the in vivo potency was evaluated in Wistar rats. In the in vitro study for freezer storage groups, the D-antigen contents for all three types decreased and were lower than the release specifications after storing at -20°C for 2 weeks. After storing at -20°C for 1 week, the D-antigen contents for types I and III in combined group of a total of 45 vials, and for type II in the specific lot groups containing 15 vials decreased, but were within the release specifications. Moreover, no significant change in in vivo potency was observed. For vaccine carrier transfer groups, the D-antigen contents did not decrease after 1 freeze-thaw cycle; in contrast, it decreased, but no significant in vivo potency loss was observed after 3 freeze-thaw cycles. These results suggest that it may be possible to retain sufficient sIPV potency after short periods of freezing or freeze-thawing during transport.

Pre- and in-service training of health care workers on immunization data management in LMICs: a scoping review

BACKGROUND

Healthcare providers (HCPs) are recognized as one of the cornerstones and drivers of health interventions. Roles such as documentation of patient care, data management, analysing, interpreting and appropriate use of data are key to ending vaccine-preventable diseases (VPDs). However, there is a great deal of uncertainty and concerns about HCPs' skills and competencies regarding immunization data handling and the importance of data use for improving service delivery in low- and middle-income countries (LMICs). Questions about the suitability and relevance of the contents of training curriculum, appropriateness of platforms through which training is delivered and the impact of such training on immunization data handling competencies and service delivery remain a source of concern. This review identified and assessed published studies that report on pre- and in-service training with a focus on HCPs' competencies and skills to manage immunization data in LMICs.

METHODS

An electronic search of six online databases was performed, in addition to websites of the WHO, Global Alliance for Vaccines and Immunization (GAVI), Oxfam International, Save the Children, Community Health Workers Central (CHW Central), UNAIDS and UNICEF. Using appropriate keywords, MeSH terms and selection procedure, 12 articles published between January 1980 and May 2019 on pre- and in-service training of HCPs, interventions geared towards standardized data collection procedures, data documentation and management of immunization data in LMICs, including curriculum reviews, were considered for analysis.

RESULTS

Of the 2705 identified references, only 12 studies met the inclusion criteria. The review provides evidence that shows that combined and multifaceted training interventions could help improve HCPs' knowledge, skills and competency on immunization data management. It further suggests that offering the right training to HCPs and sustaining standard immunization data management is hampered in LMICs by limited or/lack of training resources.

CONCLUSION

Pre-service training is fundamental in the skills' acquisition of HCPs; however, they require additional in-service training and supportive supervision to function effectively in managing immunization data tasks. Continuous capacity development in immunization data-management competencies such as data collection, analysis, interpretation, synthesis and data use should be strengthened at all levels of the health system. Furthermore, there is a need for periodic review of the immunization-training curriculum in health training institutions, capacity development and retraining tutors on the current trends in immunization data management.

Addressing the Challenges and Opportunities of the Polio Endgame: Lessons for the Future

The Global Commission for the Certification of the Eradication of Poliomyelitis certified the eradication of type 2 poliovirus in September 2015, making type 2 poliovirus the first human pathogen to be eradicated since smallpox. The eradication of type 2 poliovirus, the absence of detection of type 3 poliovirus worldwide since November 2012, and cornering type 1 poliovirus to only a few geographic areas of 3 countries has enabled implementation of the endgame of polio eradication which calls for a phased withdrawal of oral polio vaccine beginning with the type 2 component, introduction of inactivated poliovirus vaccine, strengthening of routine immunization in countries with extensive polio resources, and initiating activities to transition polio resources, program experience, and lessons learned to other global health initiatives. This supplement focuses on efforts by global partners to successfully launch polio endgame activities to permanently secure and sustain the enormous gains of polio eradication forever.