Leading indicators of mosquito-borne disease elimination

The potential of resilience indicators to anticipate infectious disease outbreaks, a systematic review and guide

To reduce the consequences of infectious disease outbreaks, the timely implementation of public health measures is crucial. Currently used early-warning systems are highly context-dependent and require a long phase of model building. A proposed solution to anticipate the onset or termination of an outbreak is the use of so-called resilience indicators. These indicators are based on the generic theory of critical slowing down and require only incidence time series. Here we assess the potential for this approach to contribute to outbreak anticipation. We systematically reviewed studies that used resilience indicators to predict outbreaks or terminations of epidemics. We identified 37 studies meeting the inclusion criteria: 21 using simulated data and 16 real-world data. 36 out of 37 studies detected significant signs of critical slowing down before a critical transition (i.e., the onset or end of an outbreak), with a highly variable sensitivity (i.e., the proportion of true positive outbreak warnings) ranging from 0.03 to 1 and a lead time ranging from 10 days to 68 months. Challenges include low resolution and limited length of time series, a too rapid increase in cases, and strong seasonal patterns which may hamper the sensitivity of resilience indicators. Alternative types of data, such as Google searches or social media data, have the potential to improve predictions in some cases. Resilience indicators may be useful when the risk of disease outbreaks is changing gradually. This may happen, for instance, when pathogens become increasingly adapted to an environment or evolve gradually to escape immunity. High-resolution monitoring is needed to reach sufficient sensitivity. If those conditions are met, resilience indicators could help improve the current practice of prediction, facilitating timely outbreak response. We provide a step-by-step guide on the use of resilience indicators in infectious disease epidemiology, and guidance on the relevant situations to use this approach.

Anticipating infectious disease re-emergence and elimination: a test of early warning signals using empirically based models

Timely forecasts of the emergence, re-emergence and elimination of human infectious diseases allow for proactive, rather than reactive, decisions that save lives. Recent theory suggests that a generic feature of dynamical systems approaching a tipping point-early warning signals (EWS) due to critical slowing down (CSD)-can anticipate disease emergence and elimination. Empirical studies documenting CSD in observed disease dynamics are scarce, but such demonstration of concept is essential to the further development of model-independent outbreak detection systems. Here, we use fitted, mechanistic models of measles transmission in four cities in Niger to detect CSD through statistical EWS. We find that several EWS accurately anticipate measles re-emergence and elimination, suggesting that CSD should be detectable before disease transmission systems cross key tipping points. These findings support the idea that statistical signals based on CSD, coupled with decision-support algorithms and expert judgement, could provide the basis for early warning systems of disease outbreaks.

Early warning signal reliability varies with COVID-19 waves

Early warning signals (EWSs) aim to predict changes in complex systems from phenomenological signals in time series data. These signals have recently been shown to precede the emergence of disease outbreaks, offering hope that policymakers can make predictive rather than reactive management decisions. Here, using a novel, sequential analysis in combination with daily COVID-19 case data across 24 countries, we suggest that composite EWSs consisting of variance, autocorrelation and skewness can predict nonlinear case increases, but that the predictive ability of these tools varies between waves based upon the degree of critical slowing down present. Our work suggests that in highly monitored disease time series such as COVID-19, EWSs offer the opportunity for policymakers to improve the accuracy of urgent intervention decisions but best characterize hypothesized critical transitions.

Early warning signals of infectious disease transitions: a review

Early warning signals (EWSs) are a group of statistical time-series signals which could be used to anticipate a critical transition before it is reached. EWSs are model-independent methods that have grown in popularity to support evidence of disease emergence and disease elimination. Theoretical work has demonstrated their capability of detecting disease transitions in simple epidemic models, where elimination is reached through vaccination, to more complex vector transmission, age-structured and metapopulation models. However, the exact time evolution of EWSs depends on the transition; here we review the literature to provide guidance on what trends to expect and when. Recent advances include methods which detect when an EWS becomes significant; the earlier an upcoming disease transition is detected, the more valuable an EWS will be in practice. We suggest that future work should firstly validate detection methods with synthetic and historical datasets, before addressing their performance with real-time data which is accruing. A major challenge to overcome for the use of EWSs with disease transitions is to maintain the accuracy of EWSs in data-poor settings. We demonstrate how EWSs behave on reported cases for pertussis in the USA, to highlight some limitations when detecting disease transitions with real-world data.

Prospects for detecting early warning signals in discrete event sequence data: Application to epidemiological incidence data

Early warning signals (EWS) identify systems approaching a critical transition, where the system undergoes a sudden change in state. For example, monitoring changes in variance or autocorrelation offers a computationally inexpensive method which can be used in real-time to assess when an infectious disease transitions to elimination. EWS have a promising potential to not only be used to monitor infectious diseases, but also to inform control policies to aid disease elimination. Previously, potential EWS have been identified for prevalence data, however the prevalence of a disease is often not known directly. In this work we identify EWS for incidence data, the standard data type collected by the Centers for Disease Control and Prevention (CDC) or World Health Organization (WHO). We show, through several examples, that EWS calculated on simulated incidence time series data exhibit vastly different behaviours to those previously studied on prevalence data. In particular, the variance displays a decreasing trend on the approach to disease elimination, contrary to that expected from critical slowing down theory; this could lead to unreliable indicators of elimination when calculated on real-world data. We derive analytical predictions which can be generalised for many epidemiological systems, and we support our theory with simulated studies of disease incidence. Additionally, we explore EWS calculated on the rate of incidence over time, a property which can be extracted directly from incidence data. We find that although incidence might not exhibit typical critical slowing down properties before a critical transition, the rate of incidence does, presenting a promising new data type for the application of statistical indicators.

Ross-Macdonald models: Which one should we use?

Ross-Macdonald models are the building blocks of most vector-borne disease models. Even for the same disease, different authors use different model formulations, but a study of the dynamical consequences of assuming different hypotheses is missing. In this work we present different formulations of the basic Ross-Macdonald model together with a careful discussion of the assumptions behind each model. The most general model presented is an agent based model for which arbitrary distributions for latency and infectious periods for both, host and vectors, is considered. At population level we also developed a deterministic Volterra integral equations model for which also arbitrary distributions in the waiting times are included. We compare the model solutions using different distributions for the infectious and latency periods using statistics, like the epidemic peak, or epidemic final size, to characterize the epidemic curves. The basic reproduction number (R₀) for each formulation is computed and compared with empirical estimations obtained with the agent based models. The importance of considering realistic distributions for the latent and infectious periods is highlighted and discussed. We also show that seasonality is a key driver of vector-borne disease dynamics shaping the epidemic curve and its duration.

Spatial early warning signals of social and epidemiological tipping points in a coupled behaviour-disease network

The resurgence of infectious diseases due to vaccine refusal has highlighted the role of interactions between disease dynamics and the spread of vaccine opinion on social networks. Shifts between disease elimination and outbreak regimes often occur through tipping points. It is known that tipping points can be predicted by early warning signals (EWS) based on characteristic dynamics near the critical transition, but the study of EWS in coupled behaviour-disease networks has received little attention. Here, we test several EWS indicators measuring spatial coherence and autocorrelation for their ability to predict a critical transition corresponding to disease outbreaks and vaccine refusal in a multiplex network model. The model couples paediatric infectious disease spread through a contact network to binary opinion dynamics of vaccine opinion on a social network. Through change point detection, we find that mutual information and join count indicators provided the best EWS. We also show the paediatric infectious disease natural history generates a discrepancy between population-level vaccine opinions and vaccine immunity status, such that transitions in the social network may occur before epidemiological transitions. These results suggest that monitoring social media for EWS of paediatric infectious disease outbreaks using these spatial indicators could be successful.

Early warning signals of malaria resurgence in Kericho, Kenya

Campaigns to eliminate infectious diseases could be greatly aided by methods for providing early warning signals of resurgence. Theory predicts that as a disease transmission system undergoes a transition from stability at the disease-free equilibrium to sustained transmission, it will exhibit characteristic behaviours known as critical slowing down, referring to the speed at which fluctuations in the number of cases are dampened, for instance the extinction of a local transmission chain after infection from an imported case. These phenomena include increases in several summary statistics, including lag-1 autocorrelation, variance and the first difference of variance. Here, we report the first empirical test of this prediction during the resurgence of malaria in Kericho, Kenya. For 10 summary statistics, we measured the approach to criticality in a rolling window to quantify the size of effect and directions. Nine of the statistics increased as predicted and variance, the first difference of variance, autocovariance, lag-1 autocorrelation and decay time returned early warning signals of critical slowing down based on permutation tests. These results show that time series of disease incidence collected through ordinary surveillance activities may exhibit characteristic signatures prior to an outbreak, a phenomenon that may be quite general among infectious disease systems.

Detecting critical slowing down in high-dimensional epidemiological systems

Despite medical advances, the emergence and re-emergence of infectious diseases continue to pose a public health threat. Low-dimensional epidemiological models predict that epidemic transitions are preceded by the phenomenon of critical slowing down (CSD). This has raised the possibility of anticipating disease (re-)emergence using CSD-based early-warning signals (EWS), which are statistical moments estimated from time series data. For EWS to be useful at detecting future (re-)emergence, CSD needs to be a generic (model-independent) feature of epidemiological dynamics irrespective of system complexity. Currently, it is unclear whether the predictions of CSD-derived from simple, low-dimensional systems-pertain to real systems, which are high-dimensional. To assess the generality of CSD, we carried out a simulation study of a hierarchy of models, with increasing structural complexity and dimensionality, for a measles-like infectious disease. Our five models included: i) a nonseasonal homogeneous Susceptible-Exposed-Infectious-Recovered (SEIR) model, ii) a homogeneous SEIR model with seasonality in transmission, iii) an age-structured SEIR model, iv) a multiplex network-based model (Mplex) and v) an agent-based simulator (FRED). All models were parameterised to have a herd-immunity immunization threshold of around 90% coverage, and underwent a linear decrease in vaccine uptake, from 92% to 70% over 15 years. We found evidence of CSD prior to disease re-emergence in all models. We also evaluated the performance of seven EWS: the autocorrelation, coefficient of variation, index of dispersion, kurtosis, mean, skewness, variance. Performance was scored using the Area Under the ROC Curve (AUC) statistic. The best performing EWS were the mean and variance, with AUC > 0.75 one year before the estimated transition time. These two, along with the autocorrelation and index of dispersion, are promising candidate EWS for detecting disease emergence.

The problem of detrending when analysing potential indicators of disease elimination

As we strive towards the elimination of many burdensome diseases, the question of when intervention efforts may cease is increasingly important. It can be very difficult to know when prevalences are low enough that the disease will die out without further intervention, particularly for diseases that lack accurate tests. The consequences of stopping an intervention prematurely can put back elimination efforts by decades. Critical slowing down theory predicts that as a dynamical system moves through a critical transition, deviations from the steady state return increasingly slowly. We study two potential indicators of disease elimination predicted by this theory, and investigate their response using a simple stochastic model. We compare our dynamical predictions to simulations of the fluctuation variance and coefficient of variation as the system moves through the transition to elimination. These comparisons demonstrate that the primary challenge facing the analysis of early warning signs in timeseries data is that of accurately 'detrending' the signal, in order to preserve the statistical properties of the fluctuations. We show here that detrending using the mean of even just four realisations of the process can give a significant improvement when compared to using a moving window average. Taking this idea further, we consider a 'metapopulation' model of an endemic disease, in which infection spreads in various separated areas with some movement between the subpopulations. We successfully predict the behaviour of both variance and the coefficient of variation in a metapopulation by using information from the other subpopulations to detrend the system.

Estimating the distance to an epidemic threshold

The epidemic threshold of the susceptible-infected-recovered model is a boundary separating parameters that permit epidemics from those that do not. This threshold corresponds to parameters where the system's equilibrium becomes unstable. Consequently, we use the average rate at which deviations from the equilibrium shrink to define a distance to this threshold. However, the vital dynamics of the host population may occur slowly even when transmission is far from threshold levels. Here, we show analytically how such slow dynamics can prevent estimation of the distance to the threshold from fluctuations in the susceptible population. Although these results are exact only in the limit of long-term observation of a large system, simulations show that they still provide useful insight into systems with a range of population sizes, environmental noise and observation schemes. Having established some guidelines about when estimates are accurate, we then illustrate how multiple distance estimates can be used to estimate the rate of approach to the threshold. The estimation approach is general and may be applicable to zoonotic pathogens such as Middle East respiratory syndrome-related coronavirus (MERS-CoV) as well as vaccine-preventable diseases like measles.

Disentangling reporting and disease transmission

Second-order statistics such as the variance and autocorrelation can be useful indicators of the stability of randomly perturbed systems, in some cases providing early warning of an impending, dramatic change in the system’s dynamics. One specific application area of interest is the surveillance of infectious diseases. In the context of disease (re-)emergence, a goal could be to have an indicator that is informative of whether the system is approaching the epidemic threshold, a point beyond which a major outbreak becomes possible. Prior work in this area has provided some proof of this principle but has not analytically treated the effect of imperfect observation on the behavior of indicators. This work provides expected values for several moments of the number of reported cases, where reported cases follow a binomial or negative binomial distribution with a mean based on the number of deaths in a birth-death-immigration process over some reporting interval. The normalized second factorial moment and the decay time of the number of reported cases are two indicators that are insensitive to the reporting probability. Simulation is used to show how this insensitivity could be used to distinguish a trend of increased reporting from a trend of increased transmission. The simulation study also illustrates both the high variance of estimates and the possibility of reducing the variance by averaging over an ensemble of estimates from multiple time series.

Vector Preference Annihilates Backward Bifurcation and Reduces Endemicity

We propose and analyze a mathematical model of a vector-borne disease that includes vector feeding preference for carrier hosts and intrinsic incubation in hosts. Analysis of the model reveals the following novel results. We show theoretically and numerically that vector feeding preference for carrier hosts plays an important role for the existence of both the endemic equilibria and backward bifurcation when the basic reproduction number [Formula: see text] is less than one. Moreover, by increasing the vector feeding preference value, backward bifurcation is eliminated and endemic equilibria for hosts and vectors are diminished. Therefore, the vector protects itself and this benefits the host. As an example of these phenomena, we present a case of Andean cutaneous leishmaniasis in Peru. We use parameter values from previous studies, primarily from Peru to introduce bifurcation diagrams and compute global sensitivity of [Formula: see text] in order to quantify and understand the effects of the important parameters of our model. Global sensitivity analysis via partial rank correlation coefficient shows that [Formula: see text] is highly sensitive to both sandflies feeding preference and mortality rate of sandflies.

Estimating the elimination feasibility in the 'end game' of control efforts for parasites subjected to regular mass drug administration: Methods and their application to schistosomiasis

Progress towards controlling and eliminating parasitic worms, including schistosomiasis, onchocerciasis, and lymphatic filariasis, is advancing rapidly as national governments, multinational NGOs, and pharmaceutical companies launch collaborative chemotherapeutic control campaigns. Critical questions remain regarding the potential for achieving elimination of these infections, and analytical methods can help to quickly estimate progress towards-and the probability of achieving-elimination over specific timeframes. Here, we propose the effective reproduction number, Reff, as a proxy of elimination potential for sexually reproducing worms that are subject to poor mating success at very low abundance (positive density dependence, or Allee effects). Reff is the number of parasites produced by a single reproductive parasite at a given stage in the transmission cycle, over the parasite's lifetime-it is the generalized form of the more familiar basic reproduction number, R0, which only applies at the beginning of an epidemic-and it can be estimated in a 'model-free' manner by an estimator ('ε'). We introduce ε, demonstrate its estimation using simulated data, and discuss how it may be used in planning and evaluation of ongoing elimination efforts for a range of parasitic diseases.

Anticipating epidemic transitions with imperfect data

Epidemic transitions are an important feature of infectious disease systems. As the transmissibility of a pathogen increases, the dynamics of disease spread shifts from limited stuttering chains of transmission to potentially large scale outbreaks. One proposed method to anticipate this transition are early-warning signals (EWS), summary statistics which undergo characteristic changes as the transition is approached. Although theoretically predicted, their mathematical basis does not take into account the nature of epidemiological data, which are typically aggregated into periodic case reports and subject to reporting error. The viability of EWS for epidemic transitions therefore remains uncertain. Here we demonstrate that most EWS can predict emergence even when calculated from imperfect data. We quantify performance using the area under the curve (AUC) statistic, a measure of how well an EWS distinguishes between numerical simulations of an emerging disease and one which is stationary. Values of the AUC statistic are compared across a range of different reporting scenarios. We find that different EWS respond to imperfect data differently. The mean, variance and first differenced variance all perform well unless reporting error is highly overdispersed. The autocorrelation, autocovariance and decay time perform well provided that the aggregation period of the data is larger than the serial interval and reporting error is not highly overdispersed. The coefficient of variation, skewness and kurtosis are found to be unreliable indicators of emergence. Overall, we find that seven of ten EWS considered perform well for most realistic reporting scenarios. We conclude that imperfect epidemiological data is not a barrier to using EWS for many potentially emerging diseases.

How Stochasticity Influences Leading Indicators of Critical Transitions

Many complex systems exhibit critical transitions. Of considerable interest are bifurcations, small smooth changes in underlying drivers that produce abrupt shifts in system state. Before reaching the bifurcation point, the system gradually loses stability ('critical slowing down'). Signals of critical slowing down may be detected through measurement of summary statistics, but how extrinsic and intrinsic noises influence statistical patterns prior to a transition is unclear. Here, we consider a range of stochastic models that exhibit transcritical, saddle-node and pitchfork bifurcations. Noise was assumed to be either intrinsic or extrinsic. We derived expressions for the stationary variance, autocorrelation and power spectrum for all cases. Trends in summary statistics signaling the approach of each bifurcation depend on the form of noise. For example, models with intrinsic stochasticity may predict an increase in or a decline in variance as the bifurcation parameter changes, whereas models with extrinsic noise applied additively predict an increase in variance. The ability to classify trends of summary statistics for a broad class of models enhances our understanding of how critical slowing down manifests in complex systems approaching a transition.

Indicators of transitions in biological systems

In the face of global biodiversity declines, predicting the fate of biological systems is a key goal in ecology. One popular approach is the search for early warning signals (EWSs) based on alternative stable states theory. In this review, we cover the theory behind nonlinearity in dynamic systems and techniques to detect the loss of resilience that can indicate state transitions. We describe the research done on generic abundance-based signals of instability that are derived from the phenomenon of critical slowing down, which represent the genesis of EWSs research. We highlight some of the issues facing the detection of such signals in biological systems - which are inherently complex and show low signal-to-noise ratios. We then document research on alternative signals of instability, including measuring shifts in spatial autocorrelation and trait dynamics, and discuss potential future directions for EWSs research based on detailed demographic and phenotypic data. We set EWSs research in the greater field of predictive ecology and weigh up the costs and benefits of simplicity vs. complexity in predictive models, and how the available data should steer the development of future methods. Finally, we identify some key unanswered questions that, if solved, could improve the applicability of these methods.

Experimental evidence of a pathogen invasion threshold

Host density thresholds to pathogen invasion separate regions of parameter space corresponding to endemic and disease-free states. The host density threshold is a central concept in theoretical epidemiology and a common target of human and wildlife disease control programmes, but there is mixed evidence supporting the existence of thresholds, especially in wildlife populations or for pathogens with complex transmission modes (e.g. environmental transmission). Here, we demonstrate the existence of a host density threshold for an environmentally transmitted pathogen by combining an epidemiological model with a microcosm experiment. Experimental epidemics consisted of replicate populations of naive crustacean zooplankton (Daphnia dentifera) hosts across a range of host densities (20-640 hosts l-1) that were exposed to an environmentally transmitted fungal pathogen (Metschnikowia bicuspidata). Epidemiological model simulations, parametrized independently of the experiment, qualitatively predicted experimental pathogen invasion thresholds. Variability in parameter estimates did not strongly influence outcomes, though systematic changes to key parameters have the potential to shift pathogen invasion thresholds. In summary, we provide one of the first clear experimental demonstrations of pathogen invasion thresholds in a replicated experimental system, and provide evidence that such thresholds may be predictable using independently constructed epidemiological models.

Forecasting infectious disease emergence subject to seasonal forcing

BACKGROUND

Despite high vaccination coverage, many childhood infections pose a growing threat to human populations. Accurate disease forecasting would be of tremendous value to public health. Forecasting disease emergence using early warning signals (EWS) is possible in non-seasonal models of infectious diseases. Here, we assessed whether EWS also anticipate disease emergence in seasonal models.

METHODS

We simulated the dynamics of an immunizing infectious pathogen approaching the tipping point to disease endemicity. To explore the effect of seasonality on the reliability of early warning statistics, we varied the amplitude of fluctuations around the average transmission. We proposed and analyzed two new early warning signals based on the wavelet spectrum. We measured the reliability of the early warning signals depending on the strength of their trend preceding the tipping point and then calculated the Area Under the Curve (AUC) statistic.

RESULTS

Early warning signals were reliable when disease transmission was subject to seasonal forcing. Wavelet-based early warning signals were as reliable as other conventional early warning signals. We found that removing seasonal trends, prior to analysis, did not improve early warning statistics uniformly.

CONCLUSIONS

Early warning signals anticipate the onset of critical transitions for infectious diseases which are subject to seasonal forcing. Wavelet-based early warning statistics can also be used to forecast infectious disease.

Anticipating the emergence of infectious diseases

In spite of medical breakthroughs, the emergence of pathogens continues to pose threats to both human and animal populations. We present candidate approaches for anticipating disease emergence prior to large-scale outbreaks. Through use of ideas from the theories of dynamical systems and stochastic processes we develop approaches which are not specific to a particular disease system or model, but instead have general applicability. The indicators of disease emergence detailed in this paper can be classified into two parallel approaches: a set of early-warning signals based around the theory of critical slowing down and a likelihood-based approach. To test the reliability of these two approaches we contrast theoretical predictions with simulated data. We find good support for our methods across a range of different model structures and parameter values.

Monitoring the Path to the Elimination of Infectious Diseases

During the endgame of elimination programs, parasite populations may exhibit dynamical phenomena not typical of endemic disease. Particularly, monitoring programs for tracking infection prevalence may be hampered by overall rarity, the sporadic and unpredictable timing and location of outbreaks, and under-reporting. A particularly important problem for monitoring is determining the distance that must be covered to achieve the elimination threshold at an effective reproduction number less than one. In this perspective, we suggest that this problem may be overcome by measuring critical slowing down. Critical slowing down is a phenomenon exhibited by nonlinear dynamical systems in the vicinity of a critical threshold. In infectious disease dynamics, critical slowing down is expressed as an increase in the coefficient of variation and other properties of the fluctuations in the number of cases. In simulations, we show the coefficient of variation to be insensitive to under-reporting error and therefore a robust measurement of the approach to elimination. Additionally, we show that there is an inevitable delay between the time at which the effective reproduction number is reduced to below one and complete elimination is achieved. We urge that monitoring programs include dynamical properties such as critical slowing down in their metrics for measuring achievement and avoid withdrawing control activities prematurely.