A framework for evaluating epidemic forecasts

Evaluation of models for multi-step forecasting of hand, foot and mouth disease using multi-input multi-output: A case study of Chengdu, China

BACKGROUND

Hand, foot and mouth disease (HFMD) is a public health concern that threatens the health of children. Accurately forecasting of HFMD cases multiple days ahead and early detection of peaks in the number of cases followed by timely response are essential for HFMD prevention and control. However, many studies mainly predict future one-day incidence, which reduces the flexibility of prevention and control.

METHODS

We collected the daily number of HFMD cases among children aged 0-14 years in Chengdu from 2011 to 2017, as well as meteorological and air pollutant data for the same period. The LSTM, Seq2Seq, Seq2Seq-Luong and Seq2Seq-Shih models were used to perform multi-step prediction of HFMD through multi-input multi-output. We evaluated the models in terms of overall prediction performance, the time delay and intensity of detection peaks.

RESULTS

From 2011 to 2017, HFMD in Chengdu showed seasonal trends that were consistent with temperature, air pressure, rainfall, relative humidity, and PM10. The Seq2Seq-Shih model achieved the best performance, with RMSE, sMAPE and PCC values of 13.943~22.192, 17.880~27.937, and 0.887~0.705 for the 2-day to 15-day predictions, respectively. Meanwhile, the Seq2Seq-Shih model is able to detect peaks in the next 15 days with a smaller time delay.

CONCLUSIONS

The deep learning Seq2Seq-Shih model achieves the best performance in overall and peak prediction, and is applicable to HFMD multi-step prediction based on environmental factors.

BenchMetrics Prob: benchmarking of probabilistic error/loss performance evaluation instruments for binary classification problems

Probabilistic error/loss performance evaluation instruments that are originally used for regression and time series forecasting are also applied in some binary-class or multi-class classifiers, such as artificial neural networks. This study aims to systematically assess probabilistic instruments for binary classification performance evaluation using a proposed two-stage benchmarking method called BenchMetrics Prob. The method employs five criteria and fourteen simulation cases based on hypothetical classifiers on synthetic datasets. The goal is to reveal specific weaknesses of performance instruments and to identify the most robust instrument in binary classification problems. The BenchMetrics Prob method was tested on 31 instrument/instrument variants, and the results have identified four instruments as the most robust in a binary classification context: Sum Squared Error (SSE), Mean Squared Error (MSE), Root Mean Squared Error (RMSE, as the variant of MSE), and Mean Absolute Error (MAE). As SSE has lower interpretability due to its [0, ∞) range, MAE in [0, 1] is the most convenient and robust probabilistic metric for generic purposes. In classification problems where large errors are more important than small errors, RMSE may be a better choice. Additionally, the results showed that instrument variants with summarization functions other than mean (e.g., median and geometric mean), LogLoss, and the error instruments with relative/percentage/symmetric-percentage subtypes for regression, such as Mean Absolute Percentage Error (MAPE), Symmetric MAPE (sMAPE), and Mean Relative Absolute Error (MRAE), were less robust and should be avoided. These findings suggest that researchers should employ robust probabilistic metrics when measuring and reporting performance in binary classification problems.

How heterogeneous is the dengue transmission profile in Brazil? A study in six Brazilian states

Dengue is a vector-borne disease present in most tropical countries, infecting an average of 50 to 100 million people per year. Socioeconomic, demographic, and environmental factors directly influence the transmission cycle of the dengue virus (DENV). In Brazil, these factors vary between regions producing different profiles of dengue transmission and challenging the epidemiological surveillance of the disease. In this article, we aimed at classifying the profiles of dengue transmission in 1,823 Brazilian municipalities, covering different climates, from 2010 to 2019. Time series data of dengue cases were obtained from six states: Ceará and Maranhão in the semiarid Northeast, Minas Gerais in the countryside, Espírito Santo and Rio de Janeiro in the tropical Atlantic coast, and Paraná in the subtropical region. To describe the time series, we proposed a set of epi-features of the magnitude and duration of the dengue epidemic cycles, totaling 13 indicators. Using these epi-features as inputs, a multivariate cluster algorithm was employed to classify the municipalities according to their dengue transmission profile. Municipalities were classified into four distinct dengue transmission profiles: persistent transmission (7.8%), epidemic (21.3%), episodic/epidemic (43.2%), and episodic transmission (27.6%). Different profiles were associated with the municipality’s population size and climate. Municipalities with higher incidence and larger populations tended to be classified as persistent transmission, suggesting the existence of critical community size. This association, however, varies depending on the state, indicating the importance of other factors. The proposed classification is useful for developing more specific and precise surveillance protocols for regions with different dengue transmission profiles, as well as more precise public policies for dengue prevention.

Dengue is one of the fastest-growing vector-borne diseases in the world. Currently, vaccines are experimental and are not very effective, so prevention depends on the control of the mosquito Aedes aegypti. Health promotion campaigns aimed at encouraging people to reduce mosquito breeding sites have limited effect. In addition, the heterogeneity of the territories that have dengue becomes a major challenge for the epidemiological surveillance of the disease. Brazil has a territory of continental size, and single standardized surveillance is not very effective for monitoring this arbovirus. Classifying types of dengue dynamics based on features of the epidemiological cycle in each location has the potential to increase the precision of surveillance and control strategies. In our study, we were able to classify areas according to different dengue transmission profiles, ranging from episodic to persistent transmission. These results can provide tools to guide actions aimed at achieving the World Health Organization’s goals of eliminating neglected tropical diseases in countries that have the virus.

COVID-19: Forecasting confirmed cases and deaths with a simple time series model

Forecasting the outcome of outbreaks as early and as accurately as possible is crucial for decision-making and policy implementations. A significant challenge faced by forecasters is that not all outbreaks and epidemics turn into pandemics, making the prediction of their severity difficult. At the same time, the decisions made to enforce lockdowns and other mitigating interventions versus their socioeconomic consequences are not only hard to make, but also highly uncertain. The majority of modeling approaches to outbreaks, epidemics, and pandemics take an epidemiological approach that considers biological and disease processes. In this paper, we accept the limitations of forecasting to predict the long-term trajectory of an outbreak, and instead, we propose a statistical, time series approach to modelling and predicting the short-term behavior of COVID-19. Our model assumes a multiplicative trend, aiming to capture the continuation of the two variables we predict (global confirmed cases and deaths) as well as their uncertainty. We present the timeline of producing and evaluating 10-day-ahead forecasts over a period of four months. Our simple model offers competitive forecast accuracy and estimates of uncertainty that are useful and practically relevant.

Modeling the Number of Confirmed Cases and Deaths from the COVID-19 Pandemic in the UK and Forecasting from April 15 to May 30, 2020

OBJECTIVE

The UK is one of the epicenters of coronavirus disease (COVID-19) in the world. As of April 14, there have been 93 873 confirmed patients of COVID-19 in the UK and 12 107 deaths with confirmed infection. On April 14, it was reported that COVID-19 was the cause of more than half of the deaths in London.

METHODS

The present paper addresses the modeling and forecasting of the outbreak of COVID-19 in the UK. This modeling must be accomplished through a 2-part time series model to study the number of confirmed cases and deaths. The period we aimed at a forecast was 46 days from April 15 to May 30, 2020. All the computations and simulations were conducted on Matlab R2015b, and the average curves and confidence intervals were calculated based on 100 simulations of the fitted models.

RESULTS

According to the obtained model, we expect that the cumulative number of confirmed cases will reach 282 000 with an 80% confidence interval (242 000 to 316 500) on May 30, from 93 873 on April 14. In addition, it is expected that, over this period, the number of daily new confirmed cases will fall to the interval 1330 to 6450 with the probability of 0.80 by the point estimation around 3100. Regarding death, our model establishes that the real case fatality rate of the pandemic in the UK approaches 11% (80% confidence interval: 8%-15%). Accordingly, we forecast that the total death in the UK will rise to 35 000 (28 000-50 000 with the probability of 80%).

CONCLUSIONS

The drawback of this study is the shortage of observations. Also, to conduct a more exact study, it is possible to take the number of the tests into account as an explanatory variable besides time.

Fundamental limitations on efficiently forecasting certain epidemic measures in network models

The ongoing COVID-19 pandemic underscores the importance of developing reliable forecasts that would allow decision makers to devise appropriate response strategies. Despite much recent research on the topic, epidemic forecasting remains poorly understood. Researchers have attributed the difficulty of forecasting contagion dynamics to a multitude of factors, including complex behavioral responses, uncertainty in data, the stochastic nature of the underlying process, and the high sensitivity of the disease parameters to changes in the environment. We offer a rigorous explanation of the difficulty of short-term forecasting on networked populations using ideas from computational complexity. Specifically, we show that several forecasting problems (e.g., the probability that at least a given number of people will get infected at a given time and the probability that the number of infections will reach a peak at a given time) are computationally intractable. For instance, efficient solvability of such problems would imply that the number of satisfying assignments of an arbitrary Boolean formula in conjunctive normal form can be computed efficiently, violating a widely believed hypothesis in computational complexity. This intractability result holds even under the ideal situation, where all the disease parameters are known and are assumed to be insensitive to changes in the environment. From a computational complexity viewpoint, our results, which show that contagion dynamics become unpredictable for both macroscopic and individual properties, bring out some fundamental difficulties of predicting disease parameters. On the positive side, we develop efficient algorithms or approximation algorithms for restricted versions of forecasting problems.

Novel Methods in the Surveillance of Influenza-Like Illness in Germany Using Data From a Symptom Assessment App (Ada): Observational Case Study

Background

Participatory epidemiology is an emerging field harnessing consumer data entries of symptoms. The free app Ada allows users to enter the symptoms they are experiencing and applies a probabilistic reasoning model to provide a list of possible causes for these symptoms.

Objective

The objective of our study is to explore the potential contribution of Ada data to syndromic surveillance by comparing symptoms of influenza-like illness (ILI) entered by Ada users in Germany with data from a national population-based reporting system called GrippeWeb.

Methods

We extracted data for all assessments performed by Ada users in Germany over 3 seasons (2017/18, 2018/19, and 2019/20) and identified those with ILI (report of fever with cough or sore throat). The weekly proportion of assessments in which ILI was reported was calculated (overall and stratified by age group), standardized for the German population, and compared with trends in ILI rates reported by GrippeWeb using time series graphs, scatterplots, and Pearson correlation coefficient.

Results

In total, 2.1 million Ada assessments (for any symptoms) were included. Within seasons and across age groups, the Ada data broadly replicated trends in estimated weekly ILI rates when compared with GrippeWeb data (Pearson correlation—2017-18: r=0.86, 95% CI 0.76-0.92; P<.001; 2018-19: r=0.90, 95% CI 0.84-0.94; P<.001; 2019-20: r=0.64, 95% CI 0.44-0.78; P<.001). However, there were differences in the exact timing and nature of the epidemic curves between years.

Conclusions

With careful interpretation, Ada data could contribute to identifying broad ILI trends in countries without existing population-based monitoring systems or to the syndromic surveillance of symptoms not covered by existing systems.

Rational evaluation of various epidemic models based on the COVID-19 data of China

In this paper, based on the Akaike information criterion, root mean square error and robustness coefficient, a rational evaluation of various epidemic models/methods, including seven empirical functions, four statistical inference methods and five dynamical models, on their forecasting abilities is carried out. With respect to the outbreak data of COVID-19 epidemics in China, we find that before the inflection point, all models fail to make a reliable prediction. The Logistic function consistently underestimates the final epidemic size, while the Gompertz’s function makes an overestimation in all cases. Towards statistical inference methods, the methods of sequential Bayesian and time-dependent reproduction number are more accurate at the late stage of an epidemic. And the transition-like behavior of exponential growth method from underestimation to overestimation with respect to the inflection point might be useful for constructing a more reliable forecast. Compared to ODE-based SIR, SEIR and SEIR-AHQ models, the SEIR-QD and SEIR-PO models generally show a better performance on studying the COVID-19 epidemics, whose success we believe could be attributed to a proper trade-off between model complexity and fitting accuracy. Our findings not only are crucial for the forecast of COVID-19 epidemics, but also may apply to other infectious diseases.

How well did experts and laypeople forecast the size of the COVID-19 pandemic?

Throughout the COVID-19 pandemic, social and traditional media have disseminated predictions from experts and nonexperts about its expected magnitude. How accurate were the predictions of 'experts'-individuals holding occupations or roles in subject-relevant fields, such as epidemiologists and statisticians-compared with those of the public? We conducted a survey in April 2020 of 140 UK experts and 2,086 UK laypersons; all were asked to make four quantitative predictions about the impact of COVID-19 by 31 Dec 2020. In addition to soliciting point estimates, we asked participants for lower and higher bounds of a range that they felt had a 75% chance of containing the true answer. Experts exhibited greater accuracy and calibration than laypersons, even when restricting the comparison to a subset of laypersons who scored in the top quartile on a numeracy test. Even so, experts substantially underestimated the ultimate extent of the pandemic, and the mean number of predictions for which the expert intervals contained the actual outcome was only 1.8 (out of 4), suggesting that experts should consider broadening the range of scenarios they consider plausible. Predictions of the public were even more inaccurate and poorly calibrated, suggesting that an important role remains for expert predictions as long as experts acknowledge their uncertainty.

Evaluating short-term forecasting of COVID-19 cases among different epidemiological models under a Bayesian framework

BACKGROUND

Forecasting of COVID-19 cases daily and weekly has been one of the challenges posed to governments and the health sector globally. To facilitate informed public health decisions, the concerned parties rely on short-term daily projections generated via predictive modeling. We calibrate stochastic variants of growth models and the standard susceptible-infectious-removed model into 1 Bayesian framework to evaluate and compare their short-term forecasts.

RESULTS

We implement rolling-origin cross-validation to compare the short-term forecasting performance of the stochastic epidemiological models and an autoregressive moving average model across 20 countries that had the most confirmed COVID-19 cases as of August 22, 2020.

CONCLUSION

None of the models proved to be a gold standard across all regions, while all outperformed the autoregressive moving average model in terms of the accuracy of forecast and interpretability.

Challenge of forecasting demand of medical resources and supplies during a pandemic: A comparative evaluation of three surge calculators for COVID-19

Ever since the World Health Organization (WHO) declared the new coronavirus disease 2019 (COVID-19) as a pandemic, there has been a public health debate concerning medical resources and supplies including hospital beds, intensive care units (ICU), ventilators and protective personal equipment (PPE). Forecasting COVID-19 dissemination has played a key role in informing healthcare professionals and governments on how to manage overburdened healthcare systems. However, forecasting during the pandemic remained challenging and sometimes highly controversial. Here, we highlight this challenge by performing a comparative evaluation for the estimations obtained from three COVID-19 surge calculators under different social distancing approaches, taking Lebanon as a case study. Despite discrepancies in estimations, the three surge calculators used herein agree that there will be a relative shortage in the capacity of medical resources and a significant surge in PPE demand if the social distancing policy is removed. Our results underscore the importance of implementing containment interventions including social distancing in alleviating the demand for medical care during the COVID-19 pandemic in the absence of any medication or vaccine. The paper also highlights the value of employing several models in surge planning.

Mathematical Models for COVID-19 Pandemic: A Comparative Analysis

COVID-19 pandemic represents an unprecedented global health crisis in the last 100 years. Its economic, social and health impact continues to grow and is likely to end up as one of the worst global disasters since the 1918 pandemic and the World Wars. Mathematical models have played an important role in the ongoing crisis; they have been used to inform public policies and have been instrumental in many of the social distancing measures that were instituted worldwide. In this article, we review some of the important mathematical models used to support the ongoing planning and response efforts. These models differ in their use, their mathematical form and their scope.

Models for COVID-19 Pandemic: A Comparative Analysis

COVID-19 pandemic represents an unprecedented global health crisis in the last 100 years. Its economic, social and health impact continues to grow and is likely to end up as one of the worst global disasters since the 1918 pandemic and the World Wars. Mathematical models have played an important role in the ongoing crisis; they have been used to inform public policies and have been instrumental in many of the social distancing measures that were instituted worldwide. In this article we review some of the important mathematical models used to support the ongoing planning and response efforts. These models differ in their use, their mathematical form and their scope.

A New Model for Epidemic Spreading with a Focus on COVID-19

Background: It is extremely useful to construct mathematical models to forecast and control real phenomena. One of the common applied statistical models to represent the data involving with time is the time series modeling. A novel time series model to represent the propagation of an epidemic infection in a population is presented. The model deals with addressing the cumulative number of confirmed cases. Methods: Our model is the generalization of statistical exponential growth models and can describe different stages of the outbreak of a communicable disease. Applying the mentioned procedure leads to models CVJR1 (3.2, 1.44, 3, 13) for modeling the sequence of COVID-19 from January 13 to March 5. All computations and 200 simulations were done in MatLab 8.6. Results: For comparing candidates through fitting the dataset for six pairs of (l^ and a^), we used the minimum criterion square of residuals. We present the average and 90% upper and lower bounds of the predictions made by our models for three periods. Applying the mentioned procedure led to having models with parameters (3.2, 1.44, 3, 13) for modeling the course of COVID-19 from January 13 to March 5. Conclusions: The presented model can cover the epidemic behaviors related to social networks. Our model can be adjusted to worldwide modeling for modeling a phenomenon spreading in different populations simultaneously.

Using web search queries to monitor influenza-like illness: an exploratory retrospective analysis, Netherlands, 2017/18 influenza season

BackgroundDespite the early development of Google Flu Trends in 2009, standards for digital epidemiology methods have not been established and research from European countries is scarce.AimIn this article, we study the use of web search queries to monitor influenza-like illness (ILI) rates in the Netherlands in real time.MethodsIn this retrospective analysis, we simulated the weekly use of a prediction model for estimating the then-current ILI incidence across the 2017/18 influenza season solely based on Google search query data. We used weekly ILI data as reported to The European Surveillance System (TESSY)  each week, and we removed the then-last 4 weeks from our dataset. We then fitted a prediction model based on the then-most-recent search query data from Google Trends to fill the 4-week gap ('Nowcasting'). Lasso regression, in combination with cross-validation, was applied to select predictors and to fit the 52 models, one for each week of the season.ResultsThe models provided accurate predictions with a mean and maximum absolute error of 1.40 (95% confidence interval: 1.09-1.75) and 6.36 per 10,000 population. The onset, peak and end of the epidemic were predicted with an error of 1, 3 and 2 weeks, respectively. The number of search terms retained as predictors ranged from three to five, with one keyword, 'griep' ('flu'), having the most weight in all models.DiscussionThis study demonstrates the feasibility of accurate, real-time ILI incidence predictions in the Netherlands using Google search query data.

How decision makers can use quantitative approaches to guide outbreak responses

Decision makers are responsible for directing staffing, logistics, selecting public health interventions, communicating to professionals and the public, planning future response needs, and establishing strategic and tactical priorities along with their funding requirements. Decision makers need to rapidly synthesize data from different experts across multiple disciplines, bridge data gaps and translate epidemiological analysis into an operational set of decisions for disease control. Analytic approaches can be defined for specific response phases: investigation, scale-up and control. These approaches include: improved applications of quantitative methods to generate insightful epidemiological descriptions of outbreaks; robust investigations of causal agents and risk factors; tools to assess response needs; identifying and monitoring optimal interventions or combinations of interventions; and forecasting for response planning. Data science and quantitative approaches can improve decision-making in outbreak response. To realize these benefits, we need to develop a structured approach that will improve the quality and timeliness of data collected during outbreaks, establish analytic teams within the response structure and define a research agenda for data analytics in outbreak response.

This article is part of the theme issue ‘Modelling infectious disease outbreaks in humans, animals and plants: epidemic forecasting and control’. This theme issue is linked with the earlier issue ‘Modelling infectious disease outbreaks in humans, animals and plants: approaches and important themes’.

Integer-valued functional data analysis for measles forecasting

Measles presents a unique and imminent challenge for epidemiologists and public health officials: the disease is highly contagious, yet vaccination rates are declining precipitously in many localities. Consequently, the risk of a measles outbreak continues to rise. To improve preparedness, we study historical measles data both prevaccine and postvaccine, and design new methodology to forecast measles counts with uncertainty quantification. We propose to model the disease counts as an integer-valued functional time series: measles counts are a function of time-of-year and time-ordered by year. The counts are modeled using a negative-binomial distribution conditional on a real-valued latent process, which accounts for the overdispersion observed in the data. The latent process is decomposed using an unknown basis expansion, which is learned from the data, with dynamic basis coefficients. The resulting framework provides enhanced capability to model complex seasonality, which varies dynamically from year-to-year, and offers improved multimonth-ahead point forecasts and substantially tighter forecast intervals (with correct coverage) compared to existing forecasting models. Importantly, the fully Bayesian approach provides well-calibrated and precise uncertainty quantification for epi-relevant features, such as the future value and time of the peak measles count in a given year. An R package is available online.

Forecasting dengue and influenza incidences using a sparse representation of Google trends, electronic health records, and time series data

Dengue and influenza-like illness (ILI) are two of the leading causes of viral infection in the world and it is estimated that more than half the world’s population is at risk for developing these infections. It is therefore important to develop accurate methods for forecasting dengue and ILI incidences. Since data from multiple sources (such as dengue and ILI case counts, electronic health records and frequency of multiple internet search terms from Google Trends) can improve forecasts, standard time series analysis methods are inadequate to estimate all the parameter values from the limited amount of data available if we use multiple sources. In this paper, we use a computationally efficient implementation of the known variable selection method that we call the Autoregressive Likelihood Ratio (ARLR) method. This method combines sparse representation of time series data, electronic health records data (for ILI) and Google Trends data to forecast dengue and ILI incidences. This sparse representation method uses an algorithm that maximizes an appropriate likelihood ratio at every step. Using numerical experiments, we demonstrate that our method recovers the underlying sparse model much more accurately than the lasso method. We apply our method to dengue case count data from five countries/states: Brazil, Mexico, Singapore, Taiwan, and Thailand and to ILI case count data from the United States. Numerical experiments show that our method outperforms existing time series forecasting methods in forecasting the dengue and ILI case counts. In particular, our method gives a 18 percent forecast error reduction over a leading method that also uses data from multiple sources. It also performs better than other methods in predicting the peak value of the case count and the peak time.

Dengue and influenza-like illness (ILI) are leading causes of viral infection in the world and hence it is important to develop accurate methods for forecasting their incidence. We use Autoregressive Likelihood Ratio method, which is a computationally efficient implementation of the variable selection method, in order to obtain a sparse (non-lasso) representation of time series, Google Trends and electronic health records (for ILI) data. This method is used to forecast dengue incidence in five countries/states and ILI incidence in USA. We show that this method outperforms existing time series methods in forecasting these diseases. The method is general and can also be used to forecast other diseases.

A Review of Epidemic Forecasting Using Artificial Neural Networks

Background and aims: Since accurate forecasts help inform decisions for preventive health-care intervention and epidemic control, this goal can only be achieved by making use of appropriate techniques and methodologies. As much as forecast precision is important, methods and model selection procedures are critical to forecast precision. This study aimed at providing an overview of the selection of the right artificial neural network (ANN) methodology for the epidemic forecasts. It is necessary for forecasters to apply the right tools for the epidemic forecasts with high precision. Methods: It involved sampling and survey of epidemic forecasts based on ANN. A comparison of performance using ANN forecast and other methods was reviewed. Hybrids of a neural network with other classical methods or meta-heuristics that improved performance of epidemic forecasts were analysed. Results: Implementing hybrid ANN using data transformation techniques based on improved algorithms, combining forecast models, and using technological platforms enhance the learning and generalization of ANN in forecasting epidemics. Conclusion: The selection of forecasting tool is critical to the precision of epidemic forecast; hence, a working guide for the choice of appropriate tools will help reduce inconsistency and imprecision in forecasting epidemic size in populations. ANN hybrids that combined other algorithms and models, data transformation and technology should be used for an epidemic forecast.

EpiViewer: an epidemiological application for exploring time series data

BACKGROUND

Visualization plays an important role in epidemic time series analysis and forecasting. Viewing time series data plotted on a graph can help researchers identify anomalies and unexpected trends that could be overlooked if the data were reviewed in tabular form; these details can influence a researcher's recommended course of action or choice of simulation models. However, there are challenges in reviewing data sets from multiple data sources - data can be aggregated in different ways (e.g., incidence vs. cumulative), measure different criteria (e.g., infection counts, hospitalizations, and deaths), or represent different geographical scales (e.g., nation, HHS Regions, or states), which can make a direct comparison between time series difficult. In the face of an emerging epidemic, the ability to visualize time series from various sources and organizations and to reconcile these datasets based on different criteria could be key in developing accurate forecasts and identifying effective interventions. Many tools have been developed for visualizing temporal data; however, none yet supports all the functionality needed for easy collaborative visualization and analysis of epidemic data.

RESULTS

In this paper, we present EpiViewer, a time series exploration dashboard where users can upload epidemiological time series data from a variety of sources and compare, organize, and track how data evolves as an epidemic progresses. EpiViewer provides an easy-to-use web interface for visualizing temporal datasets either as line charts or bar charts. The application provides enhanced features for visual analysis, such as hierarchical categorization, zooming, and filtering, to enable detailed inspection and comparison of multiple time series on a single canvas. Finally, EpiViewer provides several built-in statistical Epi-features to help users interpret the epidemiological curves.

CONCLUSION

EpiViewer is a single page web application that provides a framework for exploring, comparing, and organizing temporal datasets. It offers a variety of features for convenient filtering and analysis of epicurves based on meta-attribute tagging. EpiViewer also provides a platform for sharing data between groups for better comparison and analysis. Our user study demonstrated that EpiViewer is easy to use and fills a particular niche in the toolspace for visualization and exploration of epidemiological data.