The effect of mass vaccination campaigns against polio on the utilization of routine immunization services: A regression discontinuity design

Interventions addressing routine childhood immunization and its behavioral and social drivers

Introduction

Despite the advances in vaccination, there are still several challenges in reaching millions of children in low- and middle-income countries (LMICs). In this review, we present an extensive summary of the various strategies used for improving routine immunization in LMICs to aid program implementers in designing vaccination interventions.

Methods

Experimental and quasi-experimental impact evaluations conducted in LMICs evaluating the effectiveness of interventions in improving routine immunization of children aged 0-5 years or the intermediate outcomes were included from 3ie's review of systematic reviews. Some additional impact evaluation studies published in recent years in select LMICs with large number of unvaccinated children were also included. Studies were coded to identify interventions and the barriers in the study context using the intervention framework developed in 3ie's Evidence Gap Map and the WHO's Behavioral and Social Drivers (BeSD) of vaccination framework, respectively. Qualitative analysis of the content was conducted to analyze the intervention strategies and the vaccination barriers that they addressed.

Results and conclusion

One hundred and forty-two impact evaluations were included to summarize the interventions. To address attitudinal and knowledge related barriers to vaccination and to motivate caregivers, sensitization and educational programs, media campaigns, and monetary or non-monetary incentives to caregivers, that may or may not be conditional upon certain health behaviors, have been used across contexts. To improve knowledge of vaccination, its place, time, and schedule, automated voice messages and written or pictorial messages have been used as standalone or multicomponent strategies. Interventions used to improve service quality included training and education of health workers and providing monetary or non-monetary perks to them or sending reminders to them on different aspects of provision of vaccination services. Interventions like effective planning or outreach activities, follow-up of children, tracking of children that have missed vaccinations, pay-for-performance schemes and health system strengthening have also been used to improve service access and quality. Interventions aimed at mobilizing and collaborating with the community to impact social norms, attitudes, and empower communities to make health decisions have also been widely implemented.

Assessing the impact of polio supplementary immunisation activities on routine immunisation and health systems: a systematic review

Introduction

The Global Polio Eradication Initiative uses polio supplementary immunisation activities (SIAs) as a strategy to increase vaccine coverage and cease poliovirus transmission. Impact of polio SIAs on immunisation systems is frequently debated. We reviewed the impact of polio SIAs on routine immunisation and health systems during the modern era of polio eradication.

Methods

We searched nine databases for studies reporting on polio SIAs and immunisation coverage, financial investment, workforce and health services delivery. We conducted a narrative synthesis of evidence. Records prior to 1994, animal, modelling or case studies data were excluded.

Results

20/1637 unique records were included. Data on vaccine coverage were included in 70% (14/20) studies, workforce in 65% (13/20) and health services delivery in 85% (17/20). SIAs positively contributed to vaccination uptake of non-polio vaccines in seven studies, neutral in three and negative in one. Some polio SIAs contributed to workforce strengthening through training and capacity building. Polio SIAs were accompanied with increased social mobilisation and community awareness building confidence in vaccination programmes. Included studies were programmatic in nature and contained variable data, thus could not be justly critically appraised.

Conclusion

Polio SIAs are successful at increasing polio vaccine coverage, but the resources and infrastructures were not always utilised for delivery of non-polio vaccines and integration into routine service delivery. We found a gap in standardised tools to evaluate SIAs, which can then inform service integration. Our study provides data to inform SIAs evaluations, and provides important considerations for COVID-19 vaccine roll-out to strengthen health systems.

PROSPERO registration number

CRD42020152195.

30 years of polio campaigns in Ethiopia, India and Nigeria: the impacts of campaign design on vaccine hesitancy and health worker motivation

Introduction

The debate over the impact of vertical programmes, including mass vaccination, on health systems is long-standing and often polarised. Studies have assessed the effects of a given vertical health programme on a health system separately from the goals of the vertical programme itself. Further, these health system effects are often categorised as either positive or negative. Yet health systems are in fact complex, dynamic and tightly linked. Relationships between elements of the system determine programme and system-level outcomes over time.

Methods

We constructed a causal loop diagram of the interactions between mass polio vaccination campaigns and government health systems in Ethiopia, India and Nigeria, working inductively from two qualitative datasets. The first dataset was 175 interviews conducted with policymakers, officials and frontline staff in these countries in 2011–2012. The second was 101 interviews conducted with similar groups in 2019, focusing on lessons learnt from polio eradication.

Results

Pursuing high coverage in polio campaigns, without considering the dynamic impacts of campaigns on health systems, cost campaign coverage gains over time in weaker health systems with many campaigns. Over time, the systems effects of frequent campaigns, delivered through parallel structures, led to a loss of frontline worker motivation, and an increase in vaccine hesitancy in recipient populations. Co-delivery of interventions helped to mitigate these negative effects. In stronger health systems with fewer campaigns, these issues did not arise.

Conclusion

It benefits vertical programmes to reduce the construction of parallel systems and pursue co-delivery of interventions where possible, and to consider the workflow of frontline staff. Ultimately, for health campaign designs to be effective, they must make sense for those delivering and receiving campaign interventions, and must take into account the complex, adaptive nature of the health systems in which they operate. 

Impact and effect mechanisms of mass campaigns in resource-constrained health systems: quasi-experimental evidence from polio eradication in Nigeria

Background

Mass campaigns are a key strategy for delivering life-saving interventions under Global Health Initiatives, especially in weak health system contexts. They are frequently designed parallel to the health system to rapidly achieve programme targets such as vaccination coverage, but we lack quantitative evidence demonstrating their impact and effect mechanisms on health system performance at sub-/national level. This longitudinal study responds to this gap through an analysis of polio eradication campaigns in Nigeria.

Methods

Using four rounds of Demographic and Health Surveys in Nigeria between October 2000 and December 2017, we created a longitudinal dataset containing 88 881 under-5 children/pregnancies. We estimated the relationships between individuals’ campaign exposure and health system performance indices (full RI schedule attainment, maternal healthcare services utilisation and child survival) using multilevel, mixed-effects regression models applied nationally and stratified by the six geopolitical zones in Nigeria.

Results

Nationally, high-frequency mass campaigns had detrimental health systems effects that potentially left 3.6 million children deprived of full immunisation. The frequency of campaigns was most concentrated in regions with weak health systems, where the operations of RI were disrupted, alongside negative effects on child survival and institutional delivery. In contrast, regions with relatively strong health systems and few campaigns experienced beneficial effects on maternal healthcare service utilisation.

Conclusions

As we provide evidence that well-functioning health systems can benefit from mass campaigns under Global Health Initiatives, our work also challenges the established wisdom to intensify mass campaigns in weaker health systems to bypass service provision bottlenecks. Mass campaigns do not inherently benefit or damage a health system, but frequent campaigns in weak health system contexts can impede service provision. We call for an additional burden of proof and active efforts to integrate mass campaigns into routine health services by harmonising implementation plans and service delivery in weak health system contexts.

Evaluating the Effectiveness of Vaccines Using a Regression Discontinuity Design

The regression discontinuity design (RDD), first proposed in the educational psychology literature and popularized in econometrics in the 1960s, has only recently been applied to epidemiologic research. A critical aim of infectious disease epidemiologists and global health researchers is to evaluate disease prevention and control strategies, including the impact of vaccines and vaccination programs. RDDs have very rarely been used in this context. This quasi-experimental approach using observational data is designed to quantify the effect of an intervention when eligibility for the intervention is based on a defined cutoff such as age or grade in school, making it ideally suited to estimating vaccine effects given that many vaccination programs and mass-vaccination campaigns define eligibility in this way. Here, we describe key features of RDDs in general, then specific scenarios, with examples, to illustrate that RDDs are an important tool for advancing our understanding of vaccine effects. We argue that epidemiologic researchers should consider RDDs when evaluating interventions designed to prevent and control diseases. This approach can address a wide range of research questions, especially those for which randomized clinical trials would present major challenges or be infeasible. Finally, we propose specific ways in which RDDs could advance future vaccine research.

The impact of supplementary immunization activities on routine vaccination coverage: An instrumental variable analysis in five low-income countries

Background

Countries deliver vaccines either through routine health services or supplementary immunization activities (SIAs), usually community-based or door-to-door immunization campaigns. While SIAs have been successful at increasing coverage of vaccines in low- and middle-income countries, they may disrupt the delivery of routine health services. We examine the impact of SIAs on routine vaccine coverage in five low-income countries.

Methods

Data on the number and timing of SIAs conducted in various countries was compiled by WHO and obtained through UNICEF. Information on the coverage of vaccines not targeted by SIAs (e.g., DPT) was extracted from the Demographic and Health Surveys. We focus on SIAs that took place between 1996 and 2013 in Bangladesh, Senegal, Togo, Gambia, and Cote d’Ivoire, and examine outcomes for children aged 12–59 months. To avoid biases resulting from non-random placement and timing of SIAs, we use age of a child at her first SIA as an instrumental variable for total exposure to SIAs.

Results

We find that SIA exposure reduced the likelihood of receiving routine vaccines in all the countries included in the study; the coefficients of interest are however statistically insignificant for Gambia and Cote d’Ivoire. In countries that witnessed statistically significant SIA-induced declines in the likelihood of obtaining DPT 3, measles as well as BCG, reductions ranged from 1.3 percentage points (Senegal) to 5.5 percentage points (Bangladesh).

Conclusion

SIA exposure reduced routine vaccination rates in study countries. Efforts should be made to limit the detrimental impact of SIAs on the services provided by routine health systems.

Vaccination Coverage Cluster Surveys in Middle Dreib - Akkar, Lebanon: Comparison of Vaccination Coverage in Children Aged 12-59 Months Pre- and Post-Vaccination Campaign

INTRODUCTION

With the high proportion of refugee population throughout Lebanon and continuous population movement, it is sensible to believe that, in particular vulnerable areas, vaccination coverage may not be at an optimal level. Therefore, we assessed the vaccination coverage in children under 5 in a district of the Akkar governorate before and after a vaccination campaign. During the vaccination campaign, conducted in August 2015, 2,509 children were vaccinated.

MATERIALS AND METHODS

We conducted a pre- and post-vaccination campaign coverage surveys adapting the WHO EPI cluster survey to the Lebanese MoPH vaccination calendar. Percentages of coverage for each dose of each vaccine were calculated for both surveys. Factors associated with complete vaccination were explored.

RESULTS

Comparing the pre- with the post-campaign surveys, coverage for polio vaccine increased from 51.9% to 84.3%, for Pentavalent from 49.0% to 71.9%, for MMR from 36.2% to 61.0%, while the percentage of children with fully updated vaccination calendar increased from 32.9% to 53.8%. While Lebanese children were found to be better covered for some antigens compared to Syrians at the first survey, this difference disappeared at the post-campaign survey. Awareness and logistic obstacles were the primary reported causes of not complete vaccination in both surveys.

DISCUSSION

Vaccination campaigns remain a quick and effective approach to increase vaccination coverage in crisis-affected areas. However, campaigns cannot be considered as a replacement of routine vaccination services to maintain a good level of coverage.

A 'post-honeymoon' measles epidemic in Burundi: mathematical model-based analysis and implications for vaccination timing

Using a mathematical model with realistic demography, we analyze a large outbreak of measles in Muyinga sector in rural Burundi in 1988–1989. We generate simulated epidemic curves and age × time epidemic surfaces, which we qualitatively and quantitatively compare with the data. Our findings suggest that supplementary immunization activities (SIAs) should be used in places where routine vaccination cannot keep up with the increasing numbers of susceptible individuals resulting from population growth or from logistical problems such as cold chain maintenance. We use the model to characterize the relationship between SIA frequency and SIA age range necessary to suppress measles outbreaks. If SIAs are less frequent, they must expand their target age range.