Model distinguishability and inference robustness in mechanisms of cholera transmission and loss of immunity

Effect of cross-immunity in a two-strain cholera model with aquatic component

The bacteria Vibrio cholerae relies heavily upon an aquatic reservoir as a transmission route with two distinct serotypes observed in many recent outbreaks. In this paper, we extend previously studied ordinary differential equation epidemiological models to create a two-strain SIRP (susceptible-infectious-recovered-pathogen) system which incorporates both partial cross-immunity between disease strains and environmental pathogen transmission. Of particular interest are undamped anti-phase periodic solutions, as these display a type of coexistence where strains routinely switch dominance, and understanding what drives this switch can optimize the efficiency of the host population's control measures against the disease. We derive the basic reproduction number R0 and use stability analysis to examine the disease free and single-strain equilibria. We formulate a unique coexistence equilibrium and prove uniform persistence of both strains when R0>1. In addition, we simulate solutions to this system, along with seasonally forced versions of the model with and without host coinfection. Cross-immunity and transmission pathways influence damped or sustained oscillatory dynamics, where the presence of seasonality can modify, amplify or synchronize the period and phase of serotypes, driving epidemic waves. Cycling of serotypes over large time intervals, similar to observed data, is found for a range of cross-immunity levels, and the inclusion of coinfection in the model contributes to sustained anti-phase periodic solutions.

A novel method to jointly estimate transmission rate and decay rate parameters in environmental transmission models

In environmental transmission, pathogens transfer from one individual to another via the environment. It is a common transmission mechanism in a wide range of host-pathogen systems. Incorporating environmental transmission in dynamic transmission models is crucial for gauging the effect of interventions, as extrapolating model results to new situations is only valid when the mechanisms are modelled correctly. The challenge in environmental transmission models lies in not jointly identifiable parameters for pathogen shedding, decay, and transmission dynamics. To solve this unidentifiability issue, we present a stochastic environmental transmission model with a novel scaling method for shedding rate parameter and a novel estimation method that distinguishes transmission rate and decay rate parameters. The core of our scaling and estimation method is calculating exposure and relating exposure to infection risks. By scaling shedding rate parameter, we standardize exposure to pathogens contributed by one infectious individual present during one time interval to one. The standardized exposure leads to a standard definition of transmission rate parameter applicable to scenarios with different decay rate parameters. Hence, we unify direct transmission (large decay rate) and environmental transmission in a continuous manner. More importantly, our exposure-based estimation method can correctly estimate back the transmission rate and the decay rate parameters, while the commonly used trajectory-based method failed. The reason is that exposure-based method gives the correct weight to infection data from previous observation periods. The correct estimation from exposure-based method will lead to more reliable predictions of intervention impact. Using the effect of disinfection as an example, we show how incorrectly estimated parameters may lead to incorrect conclusions about the effectiveness of interventions. This illustrates the importance of correct estimation of transmission rate and decay rate parameters for extrapolating environmental transmission models and predicting intervention effects.

Benchmarking tools for a priori identifiability analysis

MOTIVATION

The theoretical possibility of determining the state and parameters of a dynamic model by measuring its outputs is given by its structural identifiability and its observability. These properties should be analysed before attempting to calibrate a model, but their a priori analysis can be challenging, requiring symbolic calculations that often have a high computational cost. In recent years, a number of software tools have been developed for this task, mostly in the systems biology community. These tools have vastly different features and capabilities, and a critical assessment of their performance is still lacking.

RESULTS

Here, we present a comprehensive study of the computational resources available for analysing structural identifiability. We consider 13 software tools developed in 7 programming languages and evaluate their performance using a set of 25 case studies created from 21 models. Our results reveal their strengths and weaknesses, provide guidelines for choosing the most appropriate tool for a given problem and highlight opportunities for future developments.

AVAILABILITY AND IMPLEMENTATION

https://github.com/Xabo-RB/Benchmarking_files.

On modelling environmentally transmitted pathogens

Many pathogens are able to replicate or survive in abiotic environments. Disease transmission models that include environmental reservoirs and environment-to-host transmission have used a variety of functional forms and modelling frameworks without a clear connection to pathogen ecology or space and time scales. We present a conceptual framework to organize microparasites based on the role that abiotic environments play in their lifecycle. Mean-field and individual-based models for environmental transmission are analysed and compared. We show considerable divergence between both modelling approaches when conditions do not facilitate well mixing and for pathogens with fast dynamics in the environment. We conclude with recommendations for modelling environmentally transmitted pathogens based on the pathogen lifecycle and time and spatial scales of the host-pathogen system under consideration.

Comparing alternative cholera vaccination strategies in Maela refugee camp: using a transmission model in public health practice

Background

Cholera is a major public health concern in displaced-person camps, which often contend with overcrowding and scarcity of resources. Maela, the largest and longest-standing refugee camp in Thailand, located along the Thai-Burmese border, experienced four cholera outbreaks between 2005 and 2010. In 2013, a cholera vaccine campaign was implemented in the camp. To assist in the evaluation of the campaign and planning for subsequent campaigns, we developed a mathematical model of cholera in Maela.

Methods

We formulated a Susceptible-Infectious-Water-Recovered-based transmission model and estimated parameters using incidence data from 2010. We next evaluated the reduction in cases conferred by several immunization strategies, varying timing, effectiveness, and resources (i.e., vaccine availability). After the vaccine campaign, we generated case forecasts for the next year, to inform on-the-ground decision-making regarding whether a booster campaign was needed.

Results

We found that preexposure vaccination can substantially reduce the risk of cholera even when <50% of the population is given the full two-dose series. Additionally, the preferred number of doses per person should be considered in the context of one vs. two dose effectiveness and vaccine availability. For reactive vaccination, a trade-off between timing and effectiveness was revealed, indicating that it may be beneficial to give one dose to more people rather than two doses to fewer people, given that a two-dose schedule would incur a delay in administration of the second dose. Forecasting using realistic coverage levels predicted that there was no need for a booster campaign in 2014 (consistent with our predictions, there was not a cholera epidemic in 2014).

Conclusions

Our analyses suggest that vaccination in conjunction with ongoing water sanitation and hygiene efforts provides an effective strategy for controlling cholera outbreaks in refugee camps. Effective preexposure vaccination depends on timing and effectiveness. If a camp is facing an outbreak, delayed distribution of vaccines can substantially alter the effectiveness of reactive vaccination, suggesting that quick distribution of vaccines may be more important than ensuring every individual receives both vaccine doses. Overall, this analysis illustrates how mathematical models can be applied in public health practice, to assist in evaluating alternative intervention strategies and inform decision-making.

Comparison of stochastic and deterministic frameworks in dengue modelling

We perform estimations of compartment models for dengue transmission in rural Cambodia with increasing complexity regarding both model structure and the account for stochasticity. On the one hand, we successively account for three embedded sources of stochasticity: observation noise, demographic variability and environmental hazard. On the other hand, complexity in the model structure is increased by introducing vector-borne transmission, explicit asymptomatic infections and interacting virus serotypes. Using two sources of case data from dengue epidemics in Kampong Cham (Cambodia), models are estimated in the bayesian framework, with Markov Chain Monte Carlo and Particle Markov Chain Monte Carlo. We highlight the advantages and drawbacks of the different formulations in a practical setting. Although in this case the deterministic models provide a good approximation of the mean trajectory for a low computational cost, the stochastic frameworks better reflect and account for parameter and simulation uncertainty.

Characterising model dynamics using sparse grid interpolation: Parameter estimation of cholera

Sparse grid interpolation is a popular numerical discretization technique for the treatment of high dimensional, multivariate problems. We consider the case of using time-series data to calibrate epidemiological models from both phenomenological and mechanistic perspectives using this computational tool. By capturing the dynamics underlying both global and local spaces, our algorithm identifies potentially optimal regions of the parameter space and directs computational effort towards resolving the dynamics and resulting fits of these regions. We demonstrate how sparse grid interpolants can be effectively deployed to fit available data and discriminate between competing hypotheses to explain the current cholera epidemic in Yemen.

Accounting for non-stationarity in epidemiology by embedding time-varying parameters in stochastic models

The spread of disease through human populations is complex. The characteristics of disease propagation evolve with time, as a result of a multitude of environmental and anthropic factors, this non-stationarity is a key factor in this huge complexity. In the absence of appropriate external data sources, to correctly describe the disease propagation, we explore a flexible approach, based on stochastic models for the disease dynamics, and on diffusion processes for the parameter dynamics. Using such a diffusion process has the advantage of not requiring a specific mathematical function for the parameter dynamics. Coupled with particle MCMC, this approach allows us to reconstruct the time evolution of some key parameters (average transmission rate for instance). Thus, by capturing the time-varying nature of the different mechanisms involved in disease propagation, the epidemic can be described. Firstly we demonstrate the efficiency of this methodology on a toy model, where the parameters and the observation process are known. Applied then to real datasets, our methodology is able, based solely on simple stochastic models, to reconstruct complex epidemics, such as flu or dengue, over long time periods. Hence we demonstrate that time-varying parameters can improve the accuracy of model performances, and we suggest that our methodology can be used as a first step towards a better understanding of a complex epidemic, in situation where data is limited and/or uncertain.

The importance of thinking beyond the water-supply in cholera epidemics: A historical urban case-study

BACKGROUND

Planning interventions to respond to cholera epidemics requires an understanding of the major transmission routes. Interrupting short-cycle (household, foodborne) transmission may require different approaches as compared long-cycle (environmentally-mediated/waterborne) transmission. However, differentiating the relative contribution of short- and long-cycle routes has remained difficult, and most cholera outbreak control efforts focus on interrupting long-cycle transmission. Here we use high-resolution epidemiological and municipal infrastructure data from a cholera outbreak in 1853 Copenhagen to explore the relative contribution of short- and long-cycle transmission routes during a major urban epidemic.

METHODOLOGY/PRINCIPAL FINDINGS

We fit a spatially explicit time-series meta-population model to 6,552 physician-reported cholera cases from Copenhagen in 1853. We estimated the contribution of long-cycle waterborne transmission between neighborhoods using historical municipal water infrastructure data, fitting the force of infection from hydraulic flow, then comparing model performance. We found the epidemic was characterized by considerable transmission heterogeneity. Some neighborhoods acted as localized transmission hotspots, while other neighborhoods were less affected or important in driving the epidemic. We found little evidence to support long-cycle transmission between hydrologically-connected neighborhoods. Collectively, these findings suggest short-cycle transmission was significant.

CONCLUSIONS/SIGNIFICANCE

Spatially targeted cholera interventions, such as reactive vaccination or sanitation/hygiene campaigns in hotspot neighborhoods, would likely have been more effective in this epidemic than control measures aimed at interrupting long-cycle transmission, such as improving municipal water quality. We recommend public health planners consider programs aimed at interrupting short-cycle transmission as essential tools in the cholera control arsenal.

Structural Sensitivity in HIV Modeling: A Case Study of Vaccination

Structural assumptions in infectious disease models, such as the choice of network or compartmental model type or the inclusion of different types of heterogeneity across individuals, might affect model predictions as much as or more than the choice of input parameters. We explore the potential implications of structural assumptions on HIV model predictions and policy conclusions. We illustrate the value of inference robustness assessment through a case study of the effects of a hypothetical HIV vaccine in multiple population subgroups over eight related transmission models, which we sequentially modify to vary over two dimensions: parameter complexity (e.g., the inclusion of age and HCV comorbidity) and contact/simulation complexity (e.g., aggregated compartmental vs. individual/disaggregated compartmental vs. network models). We find that estimates of HIV incidence reductions from network models and individual compartmental models vary, but those differences are overwhelmed by the differences in HIV incidence between such models and the aggregated compartmental models (which aggregate groups of individuals into compartments). Complexities such as age structure appear to buffer the effects of aggregation and increase the threshold of net vaccine effectiveness at which aggregated models begin to overestimate reductions. The differences introduced by parameter complexity in estimated incidence reduction also translate into substantial differences in cost-effectiveness estimates. Parameter complexity does not appear to play a consistent role in differentiating the projections of network models.

A confidence building exercise in data and identifiability: Modeling cancer chemotherapy as a case study

Mathematical modeling has a long history in the field of cancer therapeutics, and there is increasing recognition that it can help uncover the mechanisms that underlie tumor response to treatment. However, making quantitative predictions with such models often requires parameter estimation from data, raising questions of parameter identifiability and estimability. Even in the case of structural (theoretical) identifiability, imperfect data and the resulting practical unidentifiability of model parameters can make it difficult to infer the desired information, and in some cases, to yield biologically correct inferences and predictions. Here, we examine parameter identifiability and estimability using a case study of two compartmental, ordinary differential equation models of cancer treatment with drugs that are cell cycle-specific (taxol) as well as non-specific (oxaliplatin). We proceed through model building, structural identifiability analysis, parameter estimation, practical identifiability analysis and its biological implications, as well as alternative data collection protocols and experimental designs that render the model identifiable. We use the differential algebra/input-output relationship approach for structural identifiability, and primarily the profile likelihood approach for practical identifiability. Despite the models being structurally identifiable, we show that without consideration of practical identifiability, incorrect cell cycle distributions can be inferred, that would result in suboptimal therapeutic choices. We illustrate the usefulness of estimating practically identifiable combinations (in addition to the more typically considered structurally identifiable combinations) in generating biologically meaningful insights. We also use simulated data to evaluate how the practical identifiability of the model would change under alternative experimental designs. These results highlight the importance of understanding the underlying mechanisms rather than purely using parsimony or information criteria/goodness-of-fit to decide model selection questions. The overall roadmap for identifiability testing laid out here can be used to help provide mechanistic insight into complex biological phenomena, reduce experimental costs, and optimize model-driven experimentation.