Impact of vaccinations, boosters and lockdowns on COVID-19 waves in French Polynesia

Estimating the impact of vaccination and non-pharmaceutical interventions on COVID-19 incidence is complicated by several factors, including successive emergence of SARS-CoV-2 variants of concern and changing population immunity from vaccination and infection. We develop an age-structured multi-strain COVID-19 transmission model and inference framework to estimate vaccination and non-pharmaceutical intervention impact accounting for these factors. We apply this framework to COVID-19 waves in French Polynesia and estimate that the vaccination programme averted 34.8% (95% credible interval: 34.5-35.2%) of 223,000 symptomatic cases, 49.6% (48.7-50.5%) of 5830 hospitalisations and 64.2% (63.1-65.3%) of 1540 hospital deaths that would have occurred in a scenario without vaccination up to May 2022. We estimate the booster campaign contributed 4.5%, 1.9%, and 0.4% to overall reductions in cases, hospitalisations, and deaths. Our results suggest that removing lockdowns during the first two waves would have had non-linear effects on incidence by altering accumulation of population immunity. Our estimates of vaccination and booster impact differ from those for other countries due to differences in age structure, previous exposure levels and timing of variant introduction relative to vaccination, emphasising the importance of detailed analysis that accounts for these factors.

Data pipelines in a public health emergency: The human in the machine

In an emergency epidemic response, data providers supply data on a best-faith effort to modellers and analysts who are typically the end user of data collected for other primary purposes such as to inform patient care. Thus, modellers who analyse secondary data have limited ability to influence what is captured. During an emergency response, models themselves are often under constant development and require both stability in their data inputs and flexibility to incorporate new inputs as novel data sources become available. This dynamic landscape is challenging to work with. Here we outline a data pipeline used in the ongoing COVID-19 response in the UK that aims to address these issues. A data pipeline is a sequence of steps to carry the raw data through to a processed and useable model input, along with the appropriate metadata and context. In ours, each data type had an individual processing report, designed to produce outputs that could be easily combined and used downstream. Automated checks were in-built and added as new pathologies emerged. These cleaned outputs were collated at different geographic levels to provide standardised datasets. Finally, a human validation step was an essential component of the analysis pathway and permitted more nuanced issues to be captured. This framework allowed the pipeline to grow in complexity and volume and facilitated the diverse range of modelling approaches employed by researchers. Additionally, every report or modelling output could be traced back to the specific data version that informed it ensuring reproducibility of results. Our approach has been used to facilitate fast-paced analysis and has evolved over time. Our framework and its aspirations are applicable to many settings beyond COVID-19 data, for example for other outbreaks such as Ebola, or where routine and regular analyses are required.

Quantifying the effect of delaying the second COVID-19 vaccine dose in England: a mathematical modelling study

BACKGROUND

The UK was the first country to start national COVID-19 vaccination programmes, initially administering doses 3 weeks apart. However, early evidence of high vaccine effectiveness after the first dose and the emergence of the SARS-CoV-2 alpha variant prompted the UK to extend the interval between doses to 12 weeks. In this study, we aimed to quantify the effect of delaying the second vaccine dose in England.

METHODS

We used a previously described model of SARS-CoV-2 transmission, calibrated to COVID-19 surveillance data from England, including hospital admissions, hospital occupancy, seroprevalence data, and population-level PCR testing data, using a Bayesian evidence-synthesis framework. We modelled and compared the epidemic trajectory in the counterfactual scenario in which vaccine doses were administered 3 weeks apart against the real reported vaccine roll-out schedule of 12 weeks. We estimated and compared the resulting numbers of daily infections, hospital admissions, and deaths. In sensitivity analyses, we investigated scenarios spanning a range of vaccine effectiveness and waning assumptions.

FINDINGS

In the period from Dec 8, 2020, to Sept 13, 2021, the number of individuals who received a first vaccine dose was higher under the 12-week strategy than the 3-week strategy. For this period, we estimated that delaying the interval between the first and second COVID-19 vaccine doses from 3 to 12 weeks averted a median (calculated as the median of the posterior sample) of 58 000 COVID-19 hospital admissions (291 000 cumulative hospitalisations [95% credible interval 275 000-319 000] under the 3-week strategy vs 233 000 [229 000-238 000] under the 12-week strategy) and 10 100 deaths (64 800 deaths [60 200-68 900] vs 54 700 [52 800-55 600]). Similarly, we estimated that the 3-week strategy would have resulted in more infections compared with the 12-week strategy. Across all sensitivity analyses the 3-week strategy resulted in a greater number of hospital admissions. In results by age group, the 12-week strategy led to more hospitalisations and deaths in older people in spring 2021, but fewer following the emergence of the delta variant during summer 2021.

INTERPRETATION

England's delayed-second-dose vaccination strategy was informed by early real-world data on vaccine effectiveness in the context of limited vaccine supplies in a growing epidemic. Our study shows that rapidly providing partial (single-dose) vaccine-induced protection to a larger proportion of the population was successful in reducing the burden of COVID-19 hospitalisations and deaths overall.

FUNDING

UK National Institute for Health Research; UK Medical Research Council; Community Jameel; Wellcome Trust; UK Foreign, Commonwealth and Development Office; Australian National Health and Medical Research Council; and EU.

Reproducible parallel inference and simulation of stochastic state space models using odin, dust, and mcstate

State space models, including compartmental models, are used to model physical, biological and social phenomena in a broad range of scientific fields. A common way of representing the underlying processes in these models is as a system of stochastic processes which can be simulated forwards in time. Inference of model parameters based on observed time-series data can then be performed using sequential Monte Carlo techniques. However, using these methods for routine inference problems can be made difficult due to various engineering considerations: allowing model design to change in response to new data and ideas, writing model code which is highly performant, and incorporating all of this with up-to-date statistical techniques. Here, we describe a suite of packages in the R programming language designed to streamline the design and deployment of state space models, targeted at infectious disease modellers but suitable for other domains. Users describe their model in a familiar domain-specific language, which is converted into parallelised C++ code. A fast, parallel, reproducible random number generator is then used to run large numbers of model simulations in an efficient manner. We also provide standard inference and prediction routines, though the model simulator can be used directly if these do not meet the user’s needs. These packages provide guarantees on reproducibility and performance, allowing the user to focus on the model itself, rather than the underlying computation. The ability to automatically generate high-performance code that would be tedious and time-consuming to write and verify manually, particularly when adding further structure to compartments, is crucial for infectious disease modellers. Our packages have been critical to the development cycle of our ongoing real-time modelling efforts in the COVID-19 pandemic, and have the potential to do the same for models used in a number of different domains.

Non-pharmaceutical interventions, vaccination, and the SARS-CoV-2 delta variant in England: a mathematical modelling study

BACKGROUND

England's COVID-19 roadmap out of lockdown policy set out the timeline and conditions for the stepwise lifting of non-pharmaceutical interventions (NPIs) as vaccination roll-out continued, with step one starting on March 8, 2021. In this study, we assess the roadmap, the impact of the delta (B.1.617.2) variant of SARS-CoV-2, and potential future epidemic trajectories.

METHODS

This mathematical modelling study was done to assess the UK Government's four-step process to easing lockdown restrictions in England, UK. We extended a previously described model of SARS-CoV-2 transmission to incorporate vaccination and multi-strain dynamics to explicitly capture the emergence of the delta variant. We calibrated the model to English surveillance data, including hospital admissions, hospital occupancy, seroprevalence data, and population-level PCR testing data using a Bayesian evidence synthesis framework, then modelled the potential trajectory of the epidemic for a range of different schedules for relaxing NPIs. We estimated the resulting number of daily infections and hospital admissions, and daily and cumulative deaths. Three scenarios spanning a range of optimistic to pessimistic vaccine effectiveness, waning natural immunity, and cross-protection from previous infections were investigated. We also considered three levels of mixing after the lifting of restrictions.

FINDINGS

The roadmap policy was successful in offsetting the increased transmission resulting from lifting NPIs starting on March 8, 2021, with increasing population immunity through vaccination. However, because of the emergence of the delta variant, with an estimated transmission advantage of 76% (95% credible interval [95% CrI] 69-83) over alpha, fully lifting NPIs on June 21, 2021, as originally planned might have led to 3900 (95% CrI 1500-5700) peak daily hospital admissions under our central parameter scenario. Delaying until July 19, 2021, reduced peak hospital admissions by three fold to 1400 (95% CrI 700-1700) per day. There was substantial uncertainty in the epidemic trajectory, with particular sensitivity to the transmissibility of delta, level of mixing, and estimates of vaccine effectiveness.

INTERPRETATION

Our findings show that the risk of a large wave of COVID-19 hospital admissions resulting from lifting NPIs can be substantially mitigated if the timing of NPI relaxation is carefully balanced against vaccination coverage. However, with the delta variant, it might not be possible to fully lift NPIs without a third wave of hospital admissions and deaths, even if vaccination coverage is high. Variants of concern, their transmissibility, vaccine uptake, and vaccine effectiveness must be carefully monitored as countries relax pandemic control measures.

FUNDING

National Institute for Health Research, UK Medical Research Council, Wellcome Trust, and UK Foreign, Commonwealth and Development Office.

Interpreting estimates of coronavirus disease 2019 (COVID-19) vaccine efficacy and effectiveness to inform simulation studies of vaccine impact: a systematic review

Background: The multiple efficacious vaccines authorised for emergency use worldwide represent the first preventative intervention against coronavirus disease 2019 (COVID-19) that does not rely on social distancing measures. The speed at which data are emerging and the heterogeneities in study design, target populations, and implementation make it challenging to interpret and assess the likely impact of vaccine campaigns on local epidemics. We reviewed available vaccine efficacy and effectiveness studies to generate working estimates that can be used to parameterise simulation studies of vaccine impact. Methods: We searched MEDLINE, the World Health Organization’s Institutional Repository for Information Sharing, medRxiv, and vaccine manufacturer websites for studies that evaluated the emerging data on COVID-19 vaccine efficacy and effectiveness. Studies providing an estimate of the efficacy or effectiveness of a COVID-19 vaccine using disaggregated data against SARS-CoV-2 infection, symptomatic disease, severe disease, death, or transmission were included. We extracted information on study population, variants of concern (VOC), vaccine platform, dose schedule, study endpoints, and measures of impact. We applied an evidence synthesis approach to capture a range of plausible and consistent parameters for vaccine efficacy and effectiveness that can be used to inform and explore a variety of vaccination strategies as the COVID-19 pandemic evolves. Results: Of the 602 articles and reports identified, 53 were included in the analysis. The availability of vaccine efficacy and effectiveness estimates varied by vaccine and were limited for VOCs. Estimates for non-primary endpoints such as effectiveness against infection and onward transmission were sparse. Synthesised estimates were relatively consistent for the same vaccine platform for wild-type, but was more variable for VOCs. Conclusions: Assessment of efficacy and effectiveness of COVID-19 vaccines is complex. Simulation studies must acknowledge and capture the uncertainty in vaccine effectiveness to robustly explore and inform vaccination policies and policy around the lifting of non-pharmaceutical interventions.

Key epidemiological drivers and impact of interventions in the 2020 SARS-CoV-2 epidemic in England

We fitted a model of SARS-CoV-2 transmission in care homes and the community to regional surveillance data for England. Compared with other approaches, our model provides a synthesis of multiple surveillance data streams into a single coherent modeling framework, allowing transmission and severity to be disentangled from features of the surveillance system. Of the control measures implemented, only national lockdown brought the reproduction number (R_t ^eff) below 1 consistently; if introduced 1 week earlier, it could have reduced deaths in the first wave from an estimated 48,600 to 25,600 [95% credible interval (CrI): 15,900 to 38,400]. The infection fatality ratio decreased from 1.00% (95% CrI: 0.85 to 1.21%) to 0.79% (95% CrI: 0.63 to 0.99%), suggesting improved clinical care. The infection fatality ratio was higher in the elderly residing in care homes (23.3%, 95% CrI: 14.7 to 35.2%) than those residing in the community (7.9%, 95% CrI: 5.9 to 10.3%). On 2 December 2020, England was still far from herd immunity, with regional cumulative infection incidence between 7.6% (95% CrI: 5.4 to 10.2%) and 22.3% (95% CrI: 19.4 to 25.4%) of the population. Therefore, any vaccination campaign will need to achieve high coverage and a high degree of protection in vaccinated individuals to allow nonpharmaceutical interventions to be lifted without a resurgence of transmission.

Key epidemiological drivers and impact of interventions in the 2020 SARS-CoV-2 epidemic in England

We fitted a model of SARS-CoV-2 transmission in care homes and the community to regional surveillance data for England. Compared with other approaches, our model provides a synthesis of multiple surveillance data streams into a single coherent modeling framework, allowing transmission and severity to be disentangled from features of the surveillance system. Of the control measures implemented, only national lockdown brought the reproduction number (Rt eff) below 1 consistently; if introduced 1 week earlier, it could have reduced deaths in the first wave from an estimated 48,600 to 25,600 [95% credible interval (CrI): 15,900 to 38,400]. The infection fatality ratio decreased from 1.00% (95% CrI: 0.85 to 1.21%) to 0.79% (95% CrI: 0.63 to 0.99%), suggesting improved clinical care. The infection fatality ratio was higher in the elderly residing in care homes (23.3%, 95% CrI: 14.7 to 35.2%) than those residing in the community (7.9%, 95% CrI: 5.9 to 10.3%). On 2 December 2020, England was still far from herd immunity, with regional cumulative infection incidence between 7.6% (95% CrI: 5.4 to 10.2%) and 22.3% (95% CrI: 19.4 to 25.4%) of the population. Therefore, any vaccination campaign will need to achieve high coverage and a high degree of protection in vaccinated individuals to allow nonpharmaceutical interventions to be lifted without a resurgence of transmission.

Quantifying epidemiological drivers of gambiense human African Trypanosomiasis across the Democratic Republic of Congo

Gambiense human African trypanosomiasis (gHAT) is a virulent disease declining in burden but still endemic in West and Central Africa. Although it is targeted for elimination of transmission by 2030, there remain numerous questions about the drivers of infection and how these vary geographically. In this study we focus on the Democratic Republic of Congo (DRC), which accounted for 84% of the global case burden in 2016, to explore changes in transmission across the country and elucidate factors which may have contributed to the persistence of disease or success of interventions in different regions. We present a Bayesian fitting methodology, applied to 168 endemic health zones (∼100,000 population size), which allows for calibration of a mechanistic gHAT model to case data (from the World Health Organization HAT Atlas) in an adaptive and automated framework. It was found that the model needed to capture improvements in passive detection to match observed trends in the data within former Bandundu and Bas Congo provinces indicating these regions have substantially reduced time to detection. Health zones in these provinces generally had longer burn-in periods during fitting due to additional model parameters. Posterior probability distributions were found for a range of fitted parameters in each health zone; these included the basic reproduction number estimates for pre-1998 (R0) which was inferred to be between 1 and 1.14, in line with previous gHAT estimates, with higher median values typically in health zones with more case reporting in the 2000s. Previously, it was not clear whether a fall in active case finding in the period contributed to the declining case numbers. The modelling here accounts for variable screening and suggests that underlying transmission has also reduced greatly-on average 96% in former Equateur, 93% in former Bas Congo and 89% in former Bandundu-Equateur and Bandundu having had the highest case burdens in 2000. This analysis also sets out a framework to enable future predictions for the country.

Reproducible parallel inference and simulation of stochastic state space models using odin, dust, and mcstate

State space models, including compartmental models, are used to model physical, biological and social phenomena in a broad range of scientific fields. A common way of representing the underlying processes in these models is as a system of stochastic processes which can be simulated forwards in time. Inference of model parameters based on observed time-series data can then be performed using sequential Monte Carlo techniques. However, using these methods for routine inference problems can be made difficult due to various engineering considerations: allowing model design to change in response to new data and ideas, writing model code which is highly performant, and incorporating all of this with up-to-date statistical techniques. Here, we describe a suite of packages in the R programming language designed to streamline the design and deployment of state space models, targeted at infectious disease modellers but suitable for other domains. Users describe their model in a familiar domain-specific language, which is converted into parallelised C++ code. A fast, parallel, reproducible random number generator is then used to run large numbers of model simulations in an efficient manner. We also provide standard inference and prediction routines, though the model simulator can be used directly if these do not meet the user’s needs. These packages provide guarantees on reproducibility and performance, allowing the user to focus on the model itself, rather than the underlying computation. The ability to automatically generate high-performance code that would be tedious and time-consuming to write and verify manually, particularly when adding further structure to compartments, is crucial for infectious disease modellers. Our packages have been critical to the development cycle of our ongoing real-time modelling efforts in the COVID-19 pandemic, and have the potential to do the same for models used in a number of different domains.

The potential public health consequences of COVID-19 on malaria in Africa

The burden of malaria is heavily concentrated in sub-Saharan Africa (SSA) where cases and deaths associated with COVID-19 are rising¹. In response, countries are implementing societal measures aimed at curtailing transmission of SARS-CoV-2^2,3. Despite these measures, the COVID-19 epidemic could still result in millions of deaths as local health facilities become overwhelmed⁴. Advances in malaria control this century have been largely due to distribution of long-lasting insecticidal nets (LLINs)⁵, with many SSA countries having planned campaigns for 2020. In the present study, we use COVID-19 and malaria transmission models to estimate the impact of disruption of malaria prevention activities and other core health services under four different COVID-19 epidemic scenarios. If activities are halted, the malaria burden in 2020 could be more than double that of 2019. In Nigeria alone, reducing case management for 6 months and delaying LLIN campaigns could result in 81,000 (44,000-119,000) additional deaths. Mitigating these negative impacts is achievable, and LLIN distributions in particular should be prioritized alongside access to antimalarial treatments to prevent substantial malaria epidemics.

Threshold behaviour of emerging epidemics featuring contact tracing

This paper is concerned with a stochastic model for the spread of an epidemic with a contact tracing scheme, in which diagnosed individuals may name some of their infectious contacts, who are then removed if they have not been already. Traced individuals may or may not also be asked to name their own contacts. The epidemic is studied by considering an approximating, modified birth-death process with intersibling dependencies, for which a threshold parameter and expressions from which extinction probabilities may be calculated are derived. When all individuals can name their contacts, it is shown that this threshold parameter depends on the infectious period distribution only through its mean. Numerical studies show that the infectious period distribution choice can have a material effect on the threshold behaviour of an epidemic, while the dependencies help reduce spread.

Stochastic epidemic models featuring contact tracing with delays

This paper is concerned with a stochastic model for the spread of an SEIR (susceptible → exposed (=latent) → infective → removed) epidemic with a contact tracing scheme, in which removed individuals may name some of their infectious contacts, who are then removed if they have not been already after some tracing delay. The epidemic is analysed via an approximating, modified birth-death process, for which a type-reproduction number is derived in terms of unnamed individuals, that is shown to be infinite when the contact rate is sufficiently large. We obtain explicit results under the assumption of either constant or exponentially distributed infectious periods, including the epidemic extinction probability in the former case. Numerical illustrations show that, while the distributions of latent periods and delays have an effect on the spread of the epidemic, the assumption of whether the delays experienced by individuals infected by the same individual are of the same or independent length makes little difference.

Bayesian model choice for epidemic models with two levels of mixing

This paper considers the problem of choosing between competing models for infectious disease final outcome data in a population that is partitioned into households. The epidemic models are stochastic individual-based transmission models of the susceptible-infective-removed type. The main focus is on various algorithms for the estimation of Bayes factors, of which a path sampling-based algorithm is seen to give the best results. We also explore theoretical properties in the case where the within-model prior distributions become increasingly uninformative, which show the need for caution when using Bayes factors as a model choice tool. A suitable form of deviance information criterion is also considered for comparison. The theory and methods are illustrated with both artificial data, and influenza data from the Tecumseh study of illness.

Control of emerging infectious diseases using responsive imperfect vaccination and isolation

This paper is concerned with a stochastic model for the spread of an SEIR (susceptible --> exposed (= latent) --> infective --> removed) epidemic among a population partitioned into households, featuring different rates of infection for within and between households. The model incorporates responsive vaccination and isolation policies, based upon the appearance of diagnosed cases in households. Different models for imperfect vaccine response are considered. A threshold parameter R*, which determines whether or not a major epidemic can occur, and the probability of a major epidemic are obtained for different infectious and latent period distributions. Simpler expressions for these quantities are obtained in the limiting case of infinite within-household infection rate. Numerical studies suggest that the choice of infectious period distribution and whether or not latent individuals are vaccine-sensitive have a material influence on the spread of the epidemic, while, for given vaccine efficacy, the choice of vaccine action model is less influential. They also suggest that an effective isolation policy has a more significant impact than vaccination. The results show that R* alone is not sufficient to summarise the potential for an epidemic.