Algorithms for detecting and predicting influenza outbreaks: metanarrative review of prospective evaluations

Spatial early warning signals of social and epidemiological tipping points in a coupled behaviour-disease network

The resurgence of infectious diseases due to vaccine refusal has highlighted the role of interactions between disease dynamics and the spread of vaccine opinion on social networks. Shifts between disease elimination and outbreak regimes often occur through tipping points. It is known that tipping points can be predicted by early warning signals (EWS) based on characteristic dynamics near the critical transition, but the study of EWS in coupled behaviour-disease networks has received little attention. Here, we test several EWS indicators measuring spatial coherence and autocorrelation for their ability to predict a critical transition corresponding to disease outbreaks and vaccine refusal in a multiplex network model. The model couples paediatric infectious disease spread through a contact network to binary opinion dynamics of vaccine opinion on a social network. Through change point detection, we find that mutual information and join count indicators provided the best EWS. We also show the paediatric infectious disease natural history generates a discrepancy between population-level vaccine opinions and vaccine immunity status, such that transitions in the social network may occur before epidemiological transitions. These results suggest that monitoring social media for EWS of paediatric infectious disease outbreaks using these spatial indicators could be successful.

Complementing the power of deep learning with statistical model fusion: Probabilistic forecasting of influenza in Dallas County, Texas, USA

Influenza is one of the main causes of death, not only in the USA but worldwide. Its significant economic and public health impacts necessitate development of accurate and efficient algorithms for forecasting of any upcoming influenza outbreaks. Most currently available methods for influenza prediction are based on parametric time series and regression models that impose restrictive and often unverifiable assumptions on the data. In turn, more flexible machine learning models and, particularly, deep learning tools whose utility is proven in a wide range of disciplines, remain largely under-explored in epidemiological forecasting. We study the seasonal influenza in Dallas County by evaluating the forecasting ability of deep learning with feedforward neural networks as well as performance of more conventional statistical models, such as beta regression, autoregressive integrated moving average (ARIMA), least absolute shrinkage and selection operators (LASSO), and non-parametric multivariate adaptive regression splines (MARS) models for one week and two weeks ahead forecasting. Furthermore, we assess forecasting utility of Google search queries and meteorological data as exogenous predictors of influenza activity. Finally, we develop a probabilistic forecasting of influenza in Dallas County by fusing all the considered models using Bayesian model averaging.

Traditions of research in community mental health care planning and care coordination: A systematic meta-narrative review of the literature

CONTEXT

In response to political and social factors over the last sixty years mental health systems internationally have endeavoured to transfer the delivery of care from hospitals into community settings. As a result, there has been increased emphasis on the need for better quality care planning and care coordination between hospital services, community services and patients and their informal carers. The aim of this systematic review of international research is to explore which interventions have proved more or less effective in promoting personalized, recovery oriented care planning and coordination for community mental health service users.

METHODS

A systematic meta-narrative review of research from 1990 to the present was undertaken. From an initial return of 3940 papers a total of 50 research articles fulfilled the inclusion criteria, including research from the UK, Australia and the USA.

FINDINGS

Three research traditions are identified consisting of (a) research that evaluates the effects of government policies on the organization, management and delivery of services; (b) evaluations of attempts to improve organizational and service delivery efficiency; (c) service-users and carers experiences of community mental health care coordination and planning and their involvement in research. The review found no seminal papers in terms of high citation rates, or papers that were consistently cited over time. The traditions of research in this topic area have formed reactively in response to frequent and often unpredictable policy changes, rather than proactively as a result of intrinsic academic or intellectual activity. This may explain the absence of seminal literature within the subject field. As a result, the research tradition within this specific area of mental health service delivery has a relatively short history, with no one dominant researcher or researchers, tradition or seminal studies amongst or across the three traditions identified.

CONCLUSIONS

The research findings reviewed suggests a gap has existed internationally over several decades between policy aspirations and service level interventions aimed at improving personalised care planning and coordination and the realities of everyday practices and experiences of service users and carers. Substantial barriers to involvement are created through poor information exchange and insufficient opportunities for care negotiation.

FluHMM: A simple and flexible Bayesian algorithm for sentinel influenza surveillance and outbreak detection

Timely detection of the seasonal influenza epidemic is important for public health action. We introduce FluHMM, a simple but flexible Bayesian algorithm to detect and monitor the seasonal epidemic on sentinel surveillance data. No comparable historical data are required for its use. FluHMM segments a typical influenza surveillance season into five distinct phases with clear interpretation (pre-epidemic, epidemic growth, epidemic plateau, epidemic decline and post-epidemic) and provides the posterior probability of being at each phase for every week in the period under surveillance, given the available data. An alert can be raised when the probability that the epidemic has started exceeds a given threshold. An accompanying R package facilitates the application of this method in public health practice. We apply FluHMM on 12 seasons of sentinel surveillance data from Greece, and show that it achieves very good sensitivity, timeliness and perfect specificity, thereby demonstrating its usefulness. We further discuss advantages and limitations of the method, providing suggestions on how to apply it and highlighting potential future extensions such as with integrating multiple surveillance data streams.

Performances of statistical methods for the detection of seasonal influenza epidemics using a consensus-based gold standard

Influenza epidemics are monitored using influenza-like illness (ILI) data reported by health-care professionals. Timely detection of the onset of epidemics is often performed by applying a statistical method on weekly ILI incidence estimates with a large range of methods used worldwide. However, performance evaluation and comparison of these algorithms is hindered by: (1) the absence of a gold standard regarding influenza epidemic periods and (2) the absence of consensual evaluation criteria. As of now, performance evaluations metrics are based only on sensitivity, specificity and timeliness of detection, since definitions are not clear for time-repeated measurements such as weekly epidemic detection. We aimed to evaluate several epidemic detection methods by comparing their alerts to a gold standard determined by international expert consensus. We introduced new performance metrics that meet important objective of influenza surveillance in temperate countries: to detect accurately the start of the single epidemic period each year. Evaluations are presented using ILI incidence in France between 1995 and 2011. We found that the two performance metrics defined allowed discrimination between epidemic detection methods. In the context of performance detection evaluation, other metrics used commonly than the standard could better achieve the needs of real-time influenza surveillance.

Integrated Detection and Prediction of Influenza Activity for Real-Time Surveillance: Algorithm Design

Background

Influenza is a viral respiratory disease capable of causing epidemics that represent a threat to communities worldwide. The rapidly growing availability of electronic “big data” from diagnostic and prediagnostic sources in health care and public health settings permits advance of a new generation of methods for local detection and prediction of winter influenza seasons and influenza pandemics.

Objective

The aim of this study was to present a method for integrated detection and prediction of influenza virus activity in local settings using electronically available surveillance data and to evaluate its performance by retrospective application on authentic data from a Swedish county.

Methods

An integrated detection and prediction method was formally defined based on a design rationale for influenza detection and prediction methods adapted for local surveillance. The novel method was retrospectively applied on data from the winter influenza season 2008-09 in a Swedish county (population 445,000). Outcome data represented individuals who met a clinical case definition for influenza (based on International Classification of Diseases version 10 [ICD-10] codes) from an electronic health data repository. Information from calls to a telenursing service in the county was used as syndromic data source.

Results

The novel integrated detection and prediction method is based on nonmechanistic statistical models and is designed for integration in local health information systems. The method is divided into separate modules for detection and prediction of local influenza virus activity. The function of the detection module is to alert for an upcoming period of increased load of influenza cases on local health care (using influenza-diagnosis data), whereas the function of the prediction module is to predict the timing of the activity peak (using syndromic data) and its intensity (using influenza-diagnosis data). For detection modeling, exponential regression was used based on the assumption that the beginning of a winter influenza season has an exponential growth of infected individuals. For prediction modeling, linear regression was applied on 7-day periods at the time in order to find the peak timing, whereas a derivate of a normal distribution density function was used to find the peak intensity. We found that the integrated detection and prediction method detected the 2008-09 winter influenza season on its starting day (optimal timeliness 0 days), whereas the predicted peak was estimated to occur 7 days ahead of the factual peak and the predicted peak intensity was estimated to be 26% lower than the factual intensity (6.3 compared with 8.5 influenza-diagnosis cases/100,000).

Conclusions

Our detection and prediction method is one of the first integrated methods specifically designed for local application on influenza data electronically available for surveillance. The performance of the method in a retrospective study indicates that further prospective evaluations of the methods are justified.

Influenza detection and prediction algorithms: comparative accuracy trial in Östergötland county, Sweden, 2008–2012

Methods for the detection of influenza epidemics and prediction of their progress have seldom been comparatively evaluated using prospective designs. This study aimed to perform a prospective comparative trial of algorithms for the detection and prediction of increased local influenza activity. Data on clinical influenza diagnoses recorded by physicians and syndromic data from a telenursing service were used. Five detection and three prediction algorithms previously evaluated in public health settings were calibrated and then evaluated over 3 years. When applied on diagnostic data, only detection using the Serfling regression method and prediction using the non-adaptive log-linear regression method showed acceptable performances during winter influenza seasons. For the syndromic data, none of the detection algorithms displayed a satisfactory performance, while non-adaptive log-linear regression was the best performing prediction method. We conclude that evidence was found for that available algorithms for influenza detection and prediction display satisfactory performance when applied on local diagnostic data during winter influenza seasons. When applied on local syndromic data, the evaluated algorithms did not display consistent performance. Further evaluations and research on combination of methods of these types in public health information infrastructures for ‘nowcasting’ (integrated detection and prediction) of influenza activity are warranted.