One year of modeling and forecasting COVID-19 transmission to support policymakers in Connecticut

Challenges of COVID-19 Case Forecasting in the US, 2020-2021

During the COVID-19 pandemic, forecasting COVID-19 trends to support planning and response was a priority for scientists and decision makers alike. In the United States, COVID-19 forecasting was coordinated by a large group of universities, companies, and government entities led by the Centers for Disease Control and Prevention and the US COVID-19 Forecast Hub (https://covid19forecasthub.org). We evaluated approximately 9.7 million forecasts of weekly state-level COVID-19 cases for predictions 1-4 weeks into the future submitted by 24 teams from August 2020 to December 2021. We assessed coverage of central prediction intervals and weighted interval scores (WIS), adjusting for missing forecasts relative to a baseline forecast, and used a Gaussian generalized estimating equation (GEE) model to evaluate differences in skill across epidemic phases that were defined by the effective reproduction number. Overall, we found high variation in skill across individual models, with ensemble-based forecasts outperforming other approaches. Forecast skill relative to the baseline was generally higher for larger jurisdictions (e.g., states compared to counties). Over time, forecasts generally performed worst in periods of rapid changes in reported cases (either in increasing or decreasing epidemic phases) with 95% prediction interval coverage dropping below 50% during the growth phases of the winter 2020, Delta, and Omicron waves. Ideally, case forecasts could serve as a leading indicator of changes in transmission dynamics. However, while most COVID-19 case forecasts outperformed a naïve baseline model, even the most accurate case forecasts were unreliable in key phases. Further research could improve forecasts of leading indicators, like COVID-19 cases, by leveraging additional real-time data, addressing performance across phases, improving the characterization of forecast confidence, and ensuring that forecasts were coherent across spatial scales. In the meantime, it is critical for forecast users to appreciate current limitations and use a broad set of indicators to inform pandemic-related decision making.

Modeling county level COVID-19 transmission in the greater St. Louis area: Challenges of uncertainty and identifiability when fitting mechanistic models to time-varying processes

We use a compartmental model with a time-varying transmission parameter to describe county level COVID-19 transmission in the greater St. Louis area of Missouri and investigate the challenges in fitting such a model to time-varying processes. We fit this model to synthetic and real confirmed case and hospital discharge data from May to December 2020 and calculate uncertainties in the resulting parameter estimates. We also explore non-identifiability within the estimated parameter set. We find that the death rate of infectious non-hospitalized individuals, the testing parameter and the initial number of exposed individuals are not identifiable based on an investigation of correlation coefficients between pairs of parameter estimates. We also explore how this non-identifiability ties back into uncertainties in the estimated parameters and find that it inflates uncertainty in the estimates of our time-varying transmission parameter. However, we do find that R0 is not highly affected by non-identifiability of its constituent components and the uncertainties associated with the quantity are smaller than those of the estimated parameters. Parameter values estimated from data will always be associated with some uncertainty and our work highlights the importance of conducting these analyses when fitting such models to real data. Exploring identifiability and uncertainty is crucial in revealing how much we can trust the parameter estimates.

Fitting a stochastic model of intensive care occupancy to noisy hospitalization time series during the COVID-19 pandemic

Intensive care occupancy is an important indicator of health care stress that has been used to guide policy decisions during the COVID-19 pandemic. Toward reliable decision-making as a pandemic progresses, estimating the rates at which patients are admitted to and discharged from hospitals and intensive care units (ICUs) is crucial. Since individual-level hospital data are rarely available to modelers in each geographic locality of interest, it is important to develop tools for inferring these rates from publicly available daily numbers of hospital and ICU beds occupied. We develop such an estimation approach based on an immigration-death process that models fluctuations of ICU occupancy. Our flexible framework allows for immigration and death rates to depend on covariates, such as hospital bed occupancy and daily SARS-CoV-2 test positivity rate, which may drive changes in hospital ICU operations. We demonstrate via simulation studies that the proposed method performs well on noisy time series data and apply our statistical framework to hospitalization data from the University of California, Irvine (UCI) Health and Orange County, California. By introducing a likelihood-based framework where immigration and death rates can vary with covariates, we find, through rigorous model selection, that hospitalization and positivity rates are crucial covariates for modeling ICU stay dynamics and validate our per-patient ICU stay estimates using anonymized patient-level UCI hospital data.

Wastewater surveillance provides 10-days forecasting of COVID-19 hospitalizations superior to cases and test positivity: A prediction study

Background

The public health response to COVID-19 has shifted to reducing deaths and hospitalizations to prevent overwhelming health systems. The amount of SARS-CoV-2 RNA fragments in wastewater are known to correlate with clinical data including cases and hospital admissions for COVID-19. We developed and tested a predictive model for incident COVID-19 hospital admissions in New York State using wastewater data.

Methods

Using county-level COVID-19 hospital admissions and wastewater surveillance covering 13.8 million people across 56 counties, we fit a generalized linear mixed model predicting new hospital admissions from wastewater concentrations of SARS-CoV-2 RNA from April 29, 2020 to June 30, 2022. We included covariates such as COVID-19 vaccine coverage in the county, comorbidities, demographic variables, and holiday gatherings.

Findings

Wastewater concentrations of SARS-CoV-2 RNA correlated with new hospital admissions per 100,000 up to ten days prior to admission. Models that included wastewater had higher predictive power than models that included clinical cases only, increasing the accuracy of the model by 15%. Predicted hospital admissions correlated highly with observed admissions (r = 0.77) with an average difference of 0.013 hospitalizations per 100,000 (95% CI = [0.002, 0.025]).

Interpretation

Using wastewater to predict future hospital admissions from COVID-19 is accurate and effective with superior results to using case data alone. The lead time of ten days could alert the public to take precautions and improve resource allocation for seasonal surges.

Semi-parametric modeling of SARS-CoV-2 transmission using tests, cases, deaths, and seroprevalence data

Mechanistic models fit to streaming surveillance data are critical to understanding the transmission dynamics of an outbreak as it unfolds in real-time. However, transmission model parameter estimation can be imprecise, and sometimes even impossible, because surveillance data are noisy and not informative about all aspects of the mechanistic model. To partially overcome this obstacle, Bayesian models have been proposed to integrate multiple surveillance data streams. We devised a modeling framework for integrating SARS-CoV-2 diagnostics test and mortality time series data, as well as seroprevalence data from cross-sectional studies, and tested the importance of individual data streams for both inference and forecasting. Importantly, our model for incidence data accounts for changes in the total number of tests performed. We model the transmission rate, infection-to-fatality ratio, and a parameter controlling a functional relationship between the true case incidence and the fraction of positive tests as time-varying quantities and estimate changes of these parameters nonparametrically. We compare our base model against modified versions which do not use diagnostics test counts or seroprevalence data to demonstrate the utility of including these often unused data streams. We apply our Bayesian data integration method to COVID-19 surveillance data collected in Orange County, California between March 2020 and February 2021 and find that 32-72% of the Orange County residents experienced SARS-CoV-2 infection by mid-January, 2021. Despite this high number of infections, our results suggest that the abrupt end of the winter surge in January 2021 was due to both behavioral changes and a high level of accumulated natural immunity.

Lessons Learned from the Lessons Learned in Public Health during the First Years of COVID-19 Pandemic

(1) Objectives: to investigate the main lessons learned from the public health (PH) response to COVID-19, using the global perspective endorsed by the WHO pillars, and understand what countries have learned from their practical actions. (2) Methods: we searched for articles in PubMed and CINAHL from 1 January 2020 to 31 January 2022. 455 articles were included. Inclusion criteria were PH themes and lessons learned from the COVID-19 pandemic. One hundred and forty-four articles were finally included in a detailed scoping review. (3) Findings: 78 lessons learned were available, cited 928 times in the 144 articles. Our review highlighted 5 main lessons learned among the WHO regions: need for continuous coordination between PH institutions and organisations (1); importance of assessment and evaluation of risk factors for the diffusion of COVID-19, identifying vulnerable populations (2); establishment of evaluation systems to assess the impact of planned PH measures (3); extensive application of digital technologies, telecommunications and electronic health records (4); need for periodic scientific reviews to provide regular updates on the most effective PH management strategies (5). (4) Conclusion: lessons found in this review could be essential for the future, providing recommendations for an increasingly flexible, fast and efficient PH response to a healthcare emergency such as the COVID-19 pandemic.

Using simulation modelling and systems science to help contain COVID-19: A systematic review

This study systematically reviews applications of three simulation approaches, that is, system dynamics model (SDM), agent-based model (ABM) and discrete event simulation (DES), and their hybrids in COVID-19 research and identifies theoretical and application innovations in public health. Among the 372 eligible papers, 72 focused on COVID-19 transmission dynamics, 204 evaluated both pharmaceutical and non-pharmaceutical interventions, 29 focused on the prediction of the pandemic and 67 investigated the impacts of COVID-19. ABM was used in 275 papers, followed by 54 SDM papers, 32 DES papers and 11 hybrid model papers. Evaluation and design of intervention scenarios are the most widely addressed area accounting for 55% of the four main categories, that is, the transmission of COVID-19, prediction of the pandemic, evaluation and design of intervention scenarios and societal impact assessment. The complexities in impact evaluation and intervention design demand hybrid simulation models that can simultaneously capture micro and macro aspects of the socio-economic systems involved.

The hiatus of the handshake

Human contact has been altered in ways that may affect endemic infections for years to come.

SARS-CoV-2 Attack Rate and Population Immunity in Southern New England, March 2020 to May 2021

IMPORTANCE

In emergency epidemic and pandemic settings, public health agencies need to be able to measure the population-level attack rate, defined as the total percentage of the population infected thus far. During vaccination campaigns in such settings, public health agencies need to be able to assess how much the vaccination campaign is contributing to population immunity; specifically, the proportion of vaccines being administered to individuals who are already seropositive must be estimated.

OBJECTIVE

To estimate population-level immunity to SARS-CoV-2 through May 31, 2021, in Rhode Island, Massachusetts, and Connecticut.

DESIGN, SETTING, AND PARTICIPANTS

This observational case series assessed cases, hospitalizations, intensive care unit occupancy, ventilator occupancy, and deaths from March 1, 2020, to May 31, 2021, in Rhode Island, Massachusetts, and Connecticut. Data were analyzed from July 2021 to November 2021.

EXPOSURES

COVID-19-positive test result reported to state department of health.

MAIN OUTCOMES AND MEASURES

The main outcomes were statistical estimates, from a bayesian inference framework, of the percentage of individuals as of May 31, 2021, who were (1) previously infected and vaccinated, (2) previously uninfected and vaccinated, and (3) previously infected but not vaccinated.

RESULTS

At the state level, there were a total of 1 160 435 confirmed COVID-19 cases in Rhode Island, Massachusetts, and Connecticut. The median age among individuals with confirmed COVID-19 was 38 years. In autumn 2020, SARS-CoV-2 population immunity (equal to the attack rate at that point) in these states was less than 15%, setting the stage for a large epidemic wave during winter 2020 to 2021. Population immunity estimates for May 31, 2021, were 73.4% (95% credible interval [CrI], 72.9%-74.1%) for Rhode Island, 64.1% (95% CrI, 64.0%-64.4%) for Connecticut, and 66.3% (95% CrI, 65.9%-66.9%) for Massachusetts, indicating that more than 33% of residents in these states were fully susceptible to infection when the Delta variant began spreading in July 2021. Despite high vaccine coverage in these states, population immunity in summer 2021 was lower than planned owing to an estimated 34.1% (95% CrI, 32.9%-35.2%) of vaccines in Rhode Island, 24.6% (95% CrI, 24.3%-25.1%) of vaccines in Connecticut, and 27.6% (95% CrI, 26.8%-28.6%) of vaccines in Massachusetts being distributed to individuals who were already seropositive.

CONCLUSIONS AND RELEVANCE

These findings suggest that future emergency-setting vaccination planning may have to prioritize high vaccine coverage over optimized vaccine distribution to ensure that sufficient levels of population immunity are reached during the course of an ongoing epidemic or pandemic.

Scaling SARS-CoV-2 wastewater concentrations to population estimates of infection

Monitoring the progression of SARS-CoV-2 outbreaks requires accurate estimation of the unobservable fraction of the population infected over time in addition to the observed numbers of COVID-19 cases, as the latter present a distorted view of the pandemic due to changes in test frequency and coverage over time. The objective of this report is to describe and illustrate an approach that produces representative estimates of the unobservable cumulative incidence of infection by scaling the daily concentrations of SARS-CoV-2 RNA in wastewater from the consistent population contribution of fecal material to the sewage collection system.

Transmission dynamics model and the coronavirus disease 2019 epidemic: applications and challenges

Since late 2019, the beginning of coronavirus disease 2019 (COVID-19) pandemic, transmission dynamics models have achieved great development and were widely used in predicting and policy making. Here, we provided an introduction to the history of disease transmission, summarized transmission dynamics models into three main types: compartment extension, parameter extension and population-stratified extension models, highlight the key contribution of transmission dynamics models in COVID-19 pandemic: estimating epidemiological parameters, predicting the future trend, evaluating the effectiveness of control measures and exploring different possibilities/scenarios. Finally, we pointed out the limitations and challenges lie ahead of transmission dynamics models.

Impact of close interpersonal contact on COVID-19 incidence: Evidence from 1 year of mobile device data

Close contact between people is the primary route for transmission of SARS-CoV-2, the virus that causes coronavirus disease 2019 (COVID-19). We quantified interpersonal contact at the population level using mobile device geolocation data. We computed the frequency of contact (within 6 feet) between people in Connecticut during February 2020 to January 2021 and aggregated counts of contact events by area of residence. When incorporated into a SEIR-type model of COVID-19 transmission, the contact rate accurately predicted COVID-19 cases in Connecticut towns. Contact in Connecticut explains the initial wave of infections during March to April, the drop in cases during June to August, local outbreaks during August to September, broad statewide resurgence during September to December, and decline in January 2021. The transmission model fits COVID-19 transmission dynamics better using the contact rate than other mobility metrics. Contact rate data can help guide social distancing and testing resource allocation.

SARS-CoV-2 attack rate and population immunity in southern New England, March 2020 - May 2021

Estimating an infectious disease attack rate requires inference on the number of reported symptomatic cases of a disease, the number of unreported symptomatic cases, and the number of asymptomatic infections. Population-level immunity can then be estimated as the attack rate plus the number of vaccine recipients who had not been previously infected; this requires an estimate of the fraction of vaccines that were distributed to seropositive individuals. To estimate attack rates and population immunity in southern New England, we fit a validated dynamic epidemiological model to case, clinical, and death data streams reported by Rhode Island, Massachusetts, and Connecticut for the first 15 months of the COVID-19 pandemic, from March 1 2020 to May 31 2021. This period includes the initial spring 2020 wave, the major winter wave of 2020-2021, and the lagging wave of lineage B.1.1.7(Alpha) infections during March-April 2021. In autumn 2020, SARS-CoV-2 population immunity (equal to the attack rate at that point) in southern New England was still below 15%, setting the stage for a large winter wave. After the roll-out of vaccines in early 2021, population immunity in many states was expected to approach 70% by spring 2021, with more than half of this immune population coming from vaccinations. Our population immunity estimates for May 31 2021 are 73.4% (95% CrI: 72.9% - 74.1%) for Rhode Island, 64.1% (95% CrI: 64.0% - 64.4%) for Connecticut, and 66.3% (95% CrI: 65.9% - 66.9%) for Massachusetts, indicating that >33% of southern Englanders were still susceptible to infection when the Delta variant began spreading in July 2021. Despite high vaccine coverage in these states, population immunity in summer 2021 was lower than planned due to 34% (Rhode Island), 25% (Connecticut), and 28% (Massachusetts) of vaccine distribution going to seropositive individuals. Future emergency-setting vaccination planning will likely have to consider over-vaccination as a strategy to ensure that high levels of population immunity are reached during the course of an ongoing epidemic.