1
|
Assad DBN, Cara J, Ortega-Mier M. Comparing Short-Term Univariate and Multivariate Time-Series Forecasting Models in Infectious Disease Outbreak. Bull Math Biol 2023; 85:9. [PMID: 36565344 PMCID: PMC9789525 DOI: 10.1007/s11538-022-01112-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2022] [Accepted: 11/29/2022] [Indexed: 12/25/2022]
Abstract
Predicting infectious disease outbreak impacts on population, healthcare resources and economics and has received a special academic focus during coronavirus (COVID-19) pandemic. Focus on human disease outbreak prediction techniques in current literature, Marques et al. (Predictive models for decision support in the COVID-19 crisis. Springer, Switzerland, 2021) state that there are four main methods to address forecasting problem: compartmental models, classic statistical models, space-state models and machine learning models. We adopt their framework to compare our research with previous works. Besides being divided by methods, forecasting problems can also be divided by the number of variables that are considered to make predictions. Considering this number of variables, forecasting problems can be classified as univariate, causal and multivariate models. Multivariate approaches have been applied in less than 10% of research found. This research is the first attempt to evaluate, over real time-series data of 3 different countries with univariate and multivariate methods to provide a short-term prediction. In literature we found no research with that scope and aim. A comparison of univariate and multivariate methods has been conducted and we concluded that besides the strong potential of multivariate methods, in our research univariate models presented best results in almost all regions' predictions.
Collapse
Affiliation(s)
- Daniel Bouzon Nagem Assad
- Universidad Politécnica de Madrid, Department of Organization Engineering, Business Administration and Statistics, Escuela Técnica Superior de Ingenieros Industriales, José Gutiérrez Abascal, 2, 28006 Madrid, Spain ,Universidade do Estado do Rio de Janeiro, Rua São Francisco Xavier, 524, Maracanã, 20550-900 Rio de Janeiro, Brazil
| | - Javier Cara
- Universidad Politécnica de Madrid, Department of Organization Engineering, Business Administration and Statistics, Escuela Técnica Superior de Ingenieros Industriales, José Gutiérrez Abascal, 2, 28006 Madrid, Spain
| | - Miguel Ortega-Mier
- Universidad Politécnica de Madrid, Department of Organization Engineering, Business Administration and Statistics, Escuela Técnica Superior de Ingenieros Industriales, José Gutiérrez Abascal, 2, 28006 Madrid, Spain
| |
Collapse
|
2
|
Barboza MFX, Monteiro KHDC, Rodrigues IR, Santos GL, Monteiro WM, Figueira EAG, Sampaio VDS, Lynn T, Endo PT. Prediction of malaria using deep learning models: A case study on city clusters in the state of Amazonas, Brazil, from 2003 to 2018. Rev Soc Bras Med Trop 2022; 55:e0420. [PMID: 35946631 PMCID: PMC9344950 DOI: 10.1590/0037-8682-0420-2021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Accepted: 04/13/2022] [Indexed: 11/22/2022] Open
Abstract
Background: Malaria is curable. Nonetheless, over 229 million cases of malaria were recorded in 2019, along with 409,000 deaths. Although over 42 million Brazilians are at risk of contracting malaria, 99% percent of all malaria cases in Brazil are located in or around the Amazon rainforest. Despite declining cases and deaths, malaria remains a major public health issue in Brazil. Accurate spatiotemporal prediction of malaria propagation may enable improved resource allocation to support efforts to eradicate the disease. Methods: In response to calls for novel research on malaria elimination strategies that suit local conditions, in this study, we propose machine learning (ML) and deep learning (DL) models to predict the probability of malaria cases in the state of Amazonas. Using a dataset of approximately 6 million records (January 2003 to December 2018), we applied k-means clustering to group cities based on their similarity of malaria incidence. We evaluated random forest, long-short term memory (LSTM) and dated recurrent unit (GRU) models and compared their performance. Results: The LSTM architecture achieved better performance in clusters with less variability in the number of cases, whereas the GRU presents better results in clusters with high variability. Although Diebold-Mariano testing suggested that both the LSTM and GRU performed comparably, GRU can be trained significantly faster, which could prove advantageous in practice. Conclusions: All models showed satisfactory accuracy and strong performance in predicting new cases of malaria, and each could serve as a supplemental tool to support regional policies and strategies.
Collapse
Affiliation(s)
| | | | | | - Guto Leoni Santos
- Universidade Federal de Pernambuco, Centro de Informática, Recife, PE, Brasil
| | - Wuelton Marcelo Monteiro
- Universidade do Estado do Amazonas, Manaus, AM, Brasil.,Fundação de Medicina Tropical Doutor Heitor Vieira Dourado, Manaus, AM, Brasil
| | - Elder Augusto Guimaraes Figueira
- Fundação de Vigilância em Saúde Rosemary Costa Pinto, Manaus, AM, Brasil.,Instituto Oswaldo Cruz, Programa de Pós-graduação Stricto Sensu em Medicina Tropical, Rio de Janeiro, RJ, Brasil
| | - Vanderson de Souza Sampaio
- Fundação de Medicina Tropical Doutor Heitor Vieira Dourado, Manaus, AM, Brasil.,Fundação de Vigilância em Saúde Rosemary Costa Pinto, Manaus, AM, Brasil.,Instituto Todos pela Saúde, São Paulo, SP, Brasil
| | - Theo Lynn
- Dublin City University, Dublin, Ireland
| | - Patricia Takako Endo
- Universidade de Pernambuco, Programa de Pós-Graduação em Engenharia da Computação, Recife, PE, Brasil
| |
Collapse
|
3
|
Chato C, Kalish ML, Poon AFY. Public health in genetic spaces: a statistical framework to optimize cluster-based outbreak detection. Virus Evol 2020; 6:veaa011. [PMID: 32190349 PMCID: PMC7069216 DOI: 10.1093/ve/veaa011] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/24/2022] Open
Abstract
Genetic clustering is a popular method for characterizing variation in transmission rates for rapidly evolving viruses, and could potentially be used to detect outbreaks in 'near real time'. However, the statistical properties of clustering are poorly understood in this context, and there are no objective guidelines for setting clustering criteria. Here, we develop a new statistical framework to optimize a genetic clustering method based on the ability to forecast new cases. We analysed the pairwise Tamura-Nei (TN93) genetic distances for anonymized HIV-1 subtype B pol sequences from Seattle (n = 1,653) and Middle Tennessee, USA (n = 2,779), and northern Alberta, Canada (n = 809). Under varying TN93 thresholds, we fit two models to the distributions of new cases relative to clusters of known cases: 1, a null model that assumes cluster growth is strictly proportional to cluster size, i.e. no variation in transmission rates among individuals; and 2, a weighted model that incorporates individual-level covariates, such as recency of diagnosis. The optimal threshold maximizes the difference in information loss between models, where covariates are used most effectively. Optimal TN93 thresholds varied substantially between data sets, e.g. 0.0104 in Alberta and 0.016 in Seattle and Tennessee, such that the optimum for one population would potentially misdirect prevention efforts in another. For a given population, the range of thresholds where the weighted model conferred greater predictive accuracy tended to be narrow (±0.005 units), and the optimal threshold tended to be stable over time. Our framework also indicated that variation in the recency of HIV diagnosis among clusters was significantly more predictive of new cases than sample collection dates (ΔAIC > 50). These results suggest that one cannot rely on historical precedence or convention to configure genetic clustering methods for public health applications, especially when translating methods between settings of low-level and generalized epidemics. Our framework not only enables investigators to calibrate a clustering method to a specific public health setting, but also provides a variable selection procedure to evaluate different predictive models of cluster growth.
Collapse
Affiliation(s)
- Connor Chato
- Department of Pathology and Laboratory Medicine, Western University, Dental Sciences Building DSB4044, London N6A 5C1, Canada
| | - Marcia L Kalish
- Division of Infectious Diseases, Department of Medicine, Vanderbilt University School of Medicine, 1161 21st Ave S, Nashville, TN 37232, USA
| | - Art F Y Poon
- Department of Pathology and Laboratory Medicine, Western University, Dental Sciences Building DSB4044, London N6A 5C1, Canada
- Department of Applied Mathematics, Western University, Middlesex College MC255, London N6A 5B7, Canada
- Department of Microbiology and Immunology, Western University, Dental Science Building DSB3014, London N6A 5C1, Canada
| |
Collapse
|