1
|
Madden WG, Jin W, Lopman B, Zufle A, Dalziel B, E. Metcalf CJ, Grenfell BT, Lau MSY. Deep neural networks for endemic measles dynamics: Comparative analysis and integration with mechanistic models. PLoS Comput Biol 2024; 20:e1012616. [PMID: 39570994 PMCID: PMC11620694 DOI: 10.1371/journal.pcbi.1012616] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2024] [Revised: 12/05/2024] [Accepted: 11/04/2024] [Indexed: 12/07/2024] Open
Abstract
Measles is an important infectious disease system both for its burden on public health and as an opportunity for studying nonlinear spatio-temporal disease dynamics. Traditional mechanistic models often struggle to fully capture the complex nonlinear spatio-temporal dynamics inherent in measles outbreaks. In this paper, we first develop a high-dimensional feed-forward neural network model with spatial features (SFNN) to forecast endemic measles outbreaks and systematically compare its predictive power with that of a classical mechanistic model (TSIR). We illustrate the utility of our model using England and Wales measles data from 1944-1965. These data present multiple modeling challenges due to the interplay between metapopulations, seasonal trends, and nonlinear dynamics related to demographic changes. Our results show that while the TSIR model yields similarly performant short-term (1 to 2 biweeks ahead) forecasts for highly populous cities, our neural network model (SFNN) consistently achieves lower root mean squared error (RMSE) across other forecasting windows. Furthermore, we show that our spatial-feature neural network model, without imposing mechanistic assumptions a priori, can uncover gravity-model-like spatial hierarchy of measles spread in which major cities play an important role in driving regional outbreaks. We then turn our attention to integrative approaches that combine mechanistic and machine learning models. Specifically, we investigate how the TSIR can be utilized to improve a state-of-the-art approach known as Physics-Informed-Neural-Networks (PINN) which explicitly combines compartmental models and neural networks. Our results show that the TSIR can facilitate the reconstruction of latent susceptible dynamics, thereby enhancing both forecasts in terms of mean absolute error (MAE) and parameter inference of measles dynamics within the PINN. In summary, our results show that appropriately designed neural network-based models can outperform traditional mechanistic models for short to long-term forecasts, while simultaneously providing mechanistic interpretability. Our work also provides valuable insights into more effectively integrating machine learning models with mechanistic models to enhance public health responses to measles and similar infectious disease systems.
Collapse
Affiliation(s)
- Wyatt G. Madden
- Department of Biostatistics and Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America
| | - Wei Jin
- Department of Computer Science, College of Arts and Sciences, Emory University, Atlanta, Georgia, United States of America
| | - Benjamin Lopman
- Department of Epidemiology, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America
| | - Andreas Zufle
- Department of Computer Science, College of Arts and Sciences, Emory University, Atlanta, Georgia, United States of America
| | - Benjamin Dalziel
- Department of Integrative Biology, Oregon State University, Oregon, United States of America
| | - C. Jessica E. Metcalf
- Department of Ecology and Evolutionary Biology, Princeton University, Princeton, New Jersey, United States of America
| | - Bryan T. Grenfell
- Department of Ecology and Evolutionary Biology, Princeton University, Princeton, New Jersey, United States of America
| | - Max S. Y. Lau
- Department of Biostatistics and Bioinformatics, Rollins School of Public Health, Emory University, Atlanta, Georgia, United States of America
| |
Collapse
|
2
|
Patterson BK, Guevara-Coto J, Mora J, Francisco EB, Yogendra R, Mora-Rodríguez RA, Beaty C, Lemaster G, Kaplan DO G, Katz A, Bellanti JA. Long COVID diagnostic with differentiation from chronic lyme disease using machine learning and cytokine hubs. Sci Rep 2024; 14:19743. [PMID: 39187577 PMCID: PMC11347643 DOI: 10.1038/s41598-024-70929-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2024] [Accepted: 08/22/2024] [Indexed: 08/28/2024] Open
Abstract
The absence of a long COVID (LC) or post-acute sequelae of COVID-19 (PASC) diagnostic has profound implications for research and potential therapeutics given the lack of specificity with symptom-based identification of LC and the overlap of symptoms with other chronic inflammatory conditions. Here, we report a machine-learning approach to LC/PASC diagnosis on 347 individuals using cytokine hubs that are also capable of differentiating LC from chronic lyme disease (CLD). We derived decision tree, random forest, and gradient-boosting machine (GBM) classifiers and compared their diagnostic capabilities on a dataset partitioned into training (178 individuals) and evaluation (45 individuals) sets. The GBM model generated 89% sensitivity and 96% specificity for LC with no evidence of overfitting. We tested the GBM on an additional random dataset (106 LC/PASC and 18 Lyme), resulting in high sensitivity (97%) and specificity (90%) for LC. We constructed a Lyme Index confirmatory algorithm to discriminate LC and CLD.
Collapse
Affiliation(s)
- Bruce K Patterson
- IncellDx Inc, 30920 Huntwood Ave, San Carlos, Hayward, CA, 94544, USA.
| | - Jose Guevara-Coto
- IncellDx Inc, 30920 Huntwood Ave, San Carlos, Hayward, CA, 94544, USA
| | - Javier Mora
- Lab of Tumor Chemosensitivity, Faculty of Microbiology, CIET/CICICA, Universidad de Costa Rica, San José, Costa Rica
| | - Edgar B Francisco
- IncellDx Inc, 30920 Huntwood Ave, San Carlos, Hayward, CA, 94544, USA
| | | | - Rodrigo A Mora-Rodríguez
- Lab of Tumor Chemosensitivity, Faculty of Microbiology, CIET/CICICA, Universidad de Costa Rica, San José, Costa Rica
| | - Christopher Beaty
- IncellDx Inc, 30920 Huntwood Ave, San Carlos, Hayward, CA, 94544, USA
| | - Gwyneth Lemaster
- IncellDx Inc, 30920 Huntwood Ave, San Carlos, Hayward, CA, 94544, USA
| | - Gary Kaplan DO
- Department of Community and Family Medicine, Georgetown University School of Medicine, Washington, DC, USA
| | - Amiram Katz
- Neurology Specialist Affiliated With Norwalk Hospital, Orange, CT, USA
| | - Joseph A Bellanti
- Departments of Pediatrics and Microbiology-Immunology, and the International Center for Interdisciplinary Studies of Immunology, Georgetown University Medical Center, Washington, DC, USA
| |
Collapse
|
3
|
Jang G, Kim J, Lee Y, Son C, Ko KT, Lee H. Analysis of the impact of COVID-19 variants and vaccination on the time-varying reproduction number: statistical methods. Front Public Health 2024; 12:1353441. [PMID: 39022412 PMCID: PMC11253806 DOI: 10.3389/fpubh.2024.1353441] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/10/2023] [Accepted: 06/07/2024] [Indexed: 07/20/2024] Open
Abstract
Introduction The COVID-19 pandemic has profoundly impacted global health systems, requiring the monitoring of infection waves and strategies to control transmission. Estimating the time-varying reproduction number is crucial for understanding the epidemic and guiding interventions. Methods Probability distributions of serial interval are estimated for Pre-Delta and Delta periods. We conducted a comparative analysis of time-varying reproduction numbers, taking into account population immunity and variant differences. We incorporated the regional heterogeneity and age distribution of the population, as well as the evolving variants and vaccination rates over time. COVID-19 transmission dynamics were analyzed with variants and vaccination. Results The reproduction number is computed with and without considering variant-based immunity. In addition, values of reproduction number significantly differed by variants, emphasizing immunity's importance. Enhanced vaccination efforts and stringent control measures were effective in reducing the transmission of the Delta variant. Conversely, Pre-Delta variant appeared less influenced by immunity levels, due to lower vaccination rates. Furthermore, during the Pre-Delta period, there was a significant difference between the region-specific and the non-region-specific reproduction numbers, with particularly distinct pattern differences observed in Gangwon, Gyeongbuk, and Jeju in Korea. Discussion This research elucidates the dynamics of COVID-19 transmission concerning the dominance of the Delta variant, the efficacy of vaccinations, and the influence of immunity levels. It highlights the necessity for targeted interventions and extensive vaccination coverage. This study makes a significant contribution to the understanding of disease transmission mechanisms and informs public health strategies.
Collapse
Affiliation(s)
- Geunsoo Jang
- Nonlinear Dynamics and Mathematical Application Center, Kyungpook National University, Daegu, Republic of Korea
| | - Jihyeon Kim
- Department of Statistics, Kyungpook National University, Daegu, Republic of Korea
| | - Yeonsu Lee
- Department of Statistics, Kyungpook National University, Daegu, Republic of Korea
| | - Changdae Son
- Department of Statistics, Kyungpook National University, Daegu, Republic of Korea
| | - Kyeong Tae Ko
- Department of Statistics, Kyungpook National University, Daegu, Republic of Korea
| | - Hyojung Lee
- Department of Statistics, Kyungpook National University, Daegu, Republic of Korea
| |
Collapse
|
4
|
Zozmann H, Schüler L, Fu X, Gawel E. Autonomous and policy-induced behavior change during the COVID-19 pandemic: Towards understanding and modeling the interplay of behavioral adaptation. PLoS One 2024; 19:e0296145. [PMID: 38696526 PMCID: PMC11065316 DOI: 10.1371/journal.pone.0296145] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Accepted: 04/07/2024] [Indexed: 05/04/2024] Open
Abstract
Changes in human behaviors, such as reductions of physical contacts and the adoption of preventive measures, impact the transmission of infectious diseases considerably. Behavioral adaptations may be the result of individuals aiming to protect themselves or mere responses to public containment measures, or a combination of both. What drives autonomous and policy-induced adaptation, how they are related and change over time is insufficiently understood. Here, we develop a framework for more precise analysis of behavioral adaptation, focusing on confluence, interactions and time variance of autonomous and policy-induced adaptation. We carry out an empirical analysis of Germany during the fall of 2020 and beyond. Subsequently, we discuss how behavioral adaptation processes can be better represented in behavioral-epidemiological models. We find that our framework is useful to understand the interplay of autonomous and policy-induced adaptation as a "moving target". Our empirical analysis suggests that mobility patterns in Germany changed significantly due to both autonomous and policy-induced adaption, with potentially weaker effects over time due to decreasing risk signals, diminishing risk perceptions and an erosion of trust in the government. We find that while a number of simulation and prediction models have made great efforts to represent behavioral adaptation, the interplay of autonomous and policy-induced adaption needs to be better understood to construct convincing counterfactual scenarios for policy analysis. The insights presented here are of interest to modelers and policy makers aiming to understand and account for behaviors during a pandemic response more accurately.
Collapse
Affiliation(s)
- Heinrich Zozmann
- Department Economics, UFZ–Helmholtz Centre for Environmental Research, Leipzig, Germany
| | - Lennart Schüler
- Center for Advanced Systems Understanding (CASUS), Görlitz, Germany
- Helmholtz-Zentrum Dresden-Rossendorf (HZDR), Dresden, Germany
- Research Data Management—RDM, UFZ–Helmholtz Centre for Environmental Research, Leipzig, Germany
- Department Monitoring and Exploration Technologies, UFZ–Helmholtz Centre for Environmental Research, Leipzig, Germany
| | - Xiaoming Fu
- Center for Advanced Systems Understanding (CASUS), Görlitz, Germany
- Helmholtz-Zentrum Dresden-Rossendorf (HZDR), Dresden, Germany
| | - Erik Gawel
- Department Economics, UFZ–Helmholtz Centre for Environmental Research, Leipzig, Germany
- Institute for Infrastructure and Resources Management, Leipzig University, Leipzig, Germany
| |
Collapse
|
5
|
Espinosa O, Mora L, Sanabria C, Ramos A, Rincón D, Bejarano V, Rodríguez J, Barrera N, Álvarez-Moreno C, Cortés J, Saavedra C, Robayo A, Franco OH. Predictive models for health outcomes due to SARS-CoV-2, including the effect of vaccination: a systematic review. Syst Rev 2024; 13:30. [PMID: 38229123 PMCID: PMC10790449 DOI: 10.1186/s13643-023-02411-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 12/04/2023] [Indexed: 01/18/2024] Open
Abstract
BACKGROUND The interaction between modelers and policymakers is becoming more common due to the increase in computing speed seen in recent decades. The recent pandemic caused by the SARS-CoV-2 virus was no exception. Thus, this study aims to identify and assess epidemiological mathematical models of SARS-CoV-2 applied to real-world data, including immunization for coronavirus 2019 (COVID-19). METHODOLOGY PubMed, JSTOR, medRxiv, LILACS, EconLit, and other databases were searched for studies employing epidemiological mathematical models of SARS-CoV-2 applied to real-world data. We summarized the information qualitatively, and each article included was assessed for bias risk using the Joanna Briggs Institute (JBI) and PROBAST checklist tool. The PROSPERO registration number is CRD42022344542. FINDINGS In total, 5646 articles were retrieved, of which 411 were included. Most of the information was published in 2021. The countries with the highest number of studies were the United States, Canada, China, and the United Kingdom; no studies were found in low-income countries. The SEIR model (susceptible, exposed, infectious, and recovered) was the most frequently used approach, followed by agent-based modeling. Moreover, the most commonly used software were R, Matlab, and Python, with the most recurring health outcomes being death and recovery. According to the JBI assessment, 61.4% of articles were considered to have a low risk of bias. INTERPRETATION The utilization of mathematical models increased following the onset of the SARS-CoV-2 pandemic. Stakeholders have begun to incorporate these analytical tools more extensively into public policy, enabling the construction of various scenarios for public health. This contribution adds value to informed decision-making. Therefore, understanding their advancements, strengths, and limitations is essential.
Collapse
Affiliation(s)
- Oscar Espinosa
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS) & Economic Models and Quantitative Methods Research Group, Centro de Investigaciones para el Desarrollo, Universidad Nacional de Colombia, Bogotá, D.C., Colombia.
| | - Laura Mora
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS), Bogotá, Colombia
| | - Cristian Sanabria
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS), Bogotá, Colombia
| | - Antonio Ramos
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS) & Economic Models and Quantitative Methods Research Group, Centro de Investigaciones para el Desarrollo, Universidad Nacional de Colombia, Bogotá, D.C., Colombia
| | - Duván Rincón
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS), Bogotá, Colombia
| | - Valeria Bejarano
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS) & Economic Models and Quantitative Methods Research Group, Centro de Investigaciones para el Desarrollo, Universidad Nacional de Colombia, Bogotá, D.C., Colombia
| | - Jhonathan Rodríguez
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS) & Economic Models and Quantitative Methods Research Group, Centro de Investigaciones para el Desarrollo, Universidad Nacional de Colombia, Bogotá, D.C., Colombia
| | - Nicolás Barrera
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS), Bogotá, Colombia
| | | | - Jorge Cortés
- Faculty of Medicine, Universidad Nacional de Colombia, Bogotá, D.C., Colombia
| | - Carlos Saavedra
- Faculty of Medicine, Universidad Nacional de Colombia, Bogotá, D.C., Colombia
| | - Adriana Robayo
- Directorate of Analytical, Economic and Actuarial Studies in Health, Instituto de Evaluación Tecnológica en Salud (IETS), Bogotá, Colombia
| | - Oscar H Franco
- University Medical Center Utrecht, Utrecht University & Harvard T.H. Chan School of Public Health, Harvard University, Cambridge, USA
| |
Collapse
|
6
|
Li R, Song Y, Qu H, Li M, Jiang GP. A data-driven epidemic model with human mobility and vaccination protection for COVID-19 prediction. J Biomed Inform 2024; 149:104571. [PMID: 38092247 DOI: 10.1016/j.jbi.2023.104571] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2023] [Revised: 11/22/2023] [Accepted: 12/07/2023] [Indexed: 12/18/2023]
Abstract
Epidemiological models allow for quantifying the dynamic characteristics of large-scale outbreaks. However, capturing detailed and accurate epidemiological information often requires consideration of multiple kinetic mechanisms and parameters. Due to the uncertainty of pandemic evolution, such as pathogen variation, host immune response and changes in mitigation strategies, the parameter evaluation and state prediction of complex epidemiological models are challenging. Here, we develop a data-driven epidemic model with a generalized SEIR mechanistic structure that includes new compartments, human mobility and vaccination protection. To address the issue of model complexity, we embed the epidemiological model dynamics into physics-informed neural networks (PINN), taking the observed series of time instances as direct input of the network to simultaneously infer unknown parameters and unobserved dynamics of the underlying model. Using actual data during the COVID-19 outbreak in Australia, Israel, and Switzerland, our model framework demonstrates satisfactory performance in multi-step ahead predictions compared to several benchmark models. Moreover, our model infers time-varying parameters such as transmission rates, hospitalization ratios, and effective reproduction numbers, as well as calculates the latent period and asymptomatic infection count, which are typically unreported in public data. Finally, we employ the proposed data-driven model to analyze the impact of different mitigation strategies on COVID-19.
Collapse
Affiliation(s)
- Ruqi Li
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
| | - Yurong Song
- College of Automation and College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, China.
| | - Hongbo Qu
- School of Computer Science, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
| | - Min Li
- College of Automation and College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| | - Guo-Ping Jiang
- College of Automation and College of Artificial Intelligence, Nanjing University of Posts and Telecommunications, Nanjing 210023, China
| |
Collapse
|
7
|
Huang Z, Liang S, Zhang H, Yang H, Lin L. On fast simulation of dynamical system with neural vector enhanced numerical solver. Sci Rep 2023; 13:15254. [PMID: 37709820 PMCID: PMC10502038 DOI: 10.1038/s41598-023-42194-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/03/2023] [Accepted: 09/06/2023] [Indexed: 09/16/2023] Open
Abstract
The large-scale simulation of dynamical systems is critical in numerous scientific and engineering disciplines. However, traditional numerical solvers are limited by the choice of step sizes when estimating integration, resulting in a trade-off between accuracy and computational efficiency. To address this challenge, we introduce a deep learning-based corrector called Neural Vector (NeurVec), which can compensate for integration errors and enable larger time step sizes in simulations. Our extensive experiments on a variety of complex dynamical system benchmarks demonstrate that NeurVec exhibits remarkable generalization capability on a continuous phase space, even when trained using limited and discrete data. NeurVec significantly accelerates traditional solvers, achieving speeds tens to hundreds of times faster while maintaining high levels of accuracy and stability. Moreover, NeurVec's simple-yet-effective design, combined with its ease of implementation, has the potential to establish a new paradigm for fast-solving differential equations based on deep learning.
Collapse
Affiliation(s)
- Zhongzhan Huang
- School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China
| | - Senwei Liang
- Department of Mathematics, Purdue University, West Lafayette, IN, USA
| | - Hong Zhang
- Mathematics and Computer Science Division, Argonne National Laboratory, Lemont, IL, USA
| | - Haizhao Yang
- Department of Mathematics, University of Maryland College Park, College Park, MD, USA
| | - Liang Lin
- School of Computer Science and Engineering, Sun Yat-sen University, Guangzhou, China.
| |
Collapse
|
8
|
Muñoz-Organero M. Space-Distributed Traffic-Enhanced LSTM-Based Machine Learning Model for COVID-19 Incidence Forecasting. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:4307708. [PMID: 36438691 PMCID: PMC9699744 DOI: 10.1155/2022/4307708] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 10/17/2022] [Accepted: 11/10/2022] [Indexed: 09/02/2023]
Abstract
The COVID-19 virus continues to generate waves of infections around the world. With major areas in developing countries still lagging behind in vaccination campaigns, the risk of new variants that can cause re-infections worldwide makes the monitoring and forecasting of the evolution of the virus a high priority. Having accurate models able to forecast the incidence of the spread of the virus provides help to policymakers and health professionals in managing the scarce resources in an optimal way. In this paper, a new machine learning model is proposed to forecast the spread of the virus one-week ahead in a geographic area which combines mobility and COVID-19 incidence data. The area is divided into zones or districts according to the location of the COVID-19 measuring points. A traffic-driven mobility estimate among adjacent districts is proposed to capture the spatial spread of the virus. Traffic-driven mobility in adjacent districts will be used together with COVID-19 incidence data to feed a new deep learning LSTM-based model which will extract patterns from mobility-modulated COVID-19 incidence spatiotemporal data in order to optimize one-week ahead estimations. The model is trained and validated with open data available for the city of Madrid (Spain) for 3 different validation scenarios. A baseline model based on previous literature able to extract temporal patterns in COVID-19 incidence time series is also trained with the same dataset. The results show that the proposed model, based on the combination of traffic and COVID-19 incidence data, is able to outperform the baseline model in all the validation scenarios.
Collapse
Affiliation(s)
- Mario Muñoz-Organero
- Telematic Engineering Department, Universidad Carlos III de Madrid, Leganes 28911, Madrid, Spain
| |
Collapse
|