1
|
Surveillance of communicable diseases using social media: A systematic review. PLoS One 2023; 18:e0282101. [PMID: 36827297 PMCID: PMC9956027 DOI: 10.1371/journal.pone.0282101] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/04/2022] [Accepted: 02/07/2023] [Indexed: 02/25/2023] Open
Abstract
BACKGROUND Communicable diseases pose a severe threat to public health and economic growth. The traditional methods that are used for public health surveillance, however, involve many drawbacks, such as being labor intensive to operate and resulting in a lag between data collection and reporting. To effectively address the limitations of these traditional methods and to mitigate the adverse effects of these diseases, a proactive and real-time public health surveillance system is needed. Previous studies have indicated the usefulness of performing text mining on social media. OBJECTIVE To conduct a systematic review of the literature that used textual content published to social media for the purpose of the surveillance and prediction of communicable diseases. METHODOLOGY Broad search queries were formulated and performed in four databases. Both journal articles and conference materials were included. The quality of the studies, operationalized as reliability and validity, was assessed. This qualitative systematic review was guided by the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines. RESULTS Twenty-three publications were included in this systematic review. All studies reported positive results for using textual social media content to surveille communicable diseases. Most studies used Twitter as a source for these data. Influenza was studied most frequently, while other communicable diseases received far less attention. Journal articles had a higher quality (reliability and validity) than conference papers. However, studies often failed to provide important information about procedures and implementation. CONCLUSION Text mining of health-related content published on social media can serve as a novel and powerful tool for the automated, real-time, and remote monitoring of public health and for the surveillance and prediction of communicable diseases in particular. This tool can address limitations related to traditional surveillance methods, and it has the potential to supplement traditional methods for public health surveillance.
Collapse
|
2
|
Glatman-Freedman A, Kaufman Z. Syndromic Surveillance of Infectious Diseases. Infect Dis (Lond) 2023. [DOI: 10.1007/978-1-0716-2463-0_1088] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/10/2023] Open
|
3
|
Uda K, Hagiya H, Yorifuji T, Koyama T, Tsuge M, Yashiro M, Tsukahara H. Correlation between national surveillance and search engine query data on respiratory syncytial virus infections in Japan. BMC Public Health 2022; 22:1517. [PMID: 35945532 PMCID: PMC9363139 DOI: 10.1186/s12889-022-13899-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2022] [Accepted: 07/25/2022] [Indexed: 11/10/2022] Open
Abstract
Background The respiratory syncytial virus (RSV) disease burden is significant, especially in infants and children with an underlying disease. Prophylaxis with palivizumab is recommended for these high-risk groups. Early recognition of a RSV epidemic is important for timely administration of palivizumab. We herein aimed to assess the correlation between national surveillance and Google Trends data pertaining to RSV infections in Japan. Methods The present, retrospective survey was performed between January 1, 2018 and November 14, 2021 and evaluated the correlation between national surveillance data and Google Trends data. Joinpoint regression was used to identify the points at which changes in trends occurred. Results A strong correlation was observed every study year (2018 [r = 0.87, p < 0.01], 2019 [r = 0.83, p < 0.01], 2020 [r = 0.83, p < 0.01], and 2021 [r = 0.96, p < 0.01]). The change-points in the Google Trends data indicating the start of the RSV epidemic were observed earlier than by sentinel surveillance in 2018 and 2021 and simultaneously with sentinel surveillance in 2019. No epidemic surge was observed in either the Google Trends or the surveillance data from 2020. Conclusions Our data suggested that Google Trends has the potential to enable the early identification of RSV epidemics. In countries without a national surveillance system, Google Trends may serve as an alternative early warning system. Supplementary Information The online version contains supplementary material available at 10.1186/s12889-022-13899-y.
Collapse
Affiliation(s)
- Kazuhiro Uda
- Department of Pediatrics, Okayama University Graduate School of Medicine, Dentistry, and Pharmaceutical Sciences, 2-5-1 Shikata, Okayama, 700-8558, Japan. .,Department of Pediatrics, Okayama University Hospital, 2-5-1 Shikata, Okayama, 700-8558, Japan.
| | - Hideharu Hagiya
- Department of General Medicine, Okayama University Graduate School of Medicine, Dentistry, and Pharmaceutical Science, 2-5-1 Shikata, Okayama, 700-8558, Japan
| | - Takashi Yorifuji
- Department of Epidemiology, Graduate School of Medicine, Dentistry, and Pharmaceutical Sciences, Okayama University, 2-5-1 Shikata, Okayama, 700-8558, Japan
| | - Toshihiro Koyama
- Department of Health Data Science, Graduate School of Medicine, Dentistry, and Pharmaceutical Sciences, Okayama University, 2-5-1 Shikata, Okayama, 700-8558, Japan
| | - Mitsuru Tsuge
- Department of Pediatrics Acute Diseases, Okayama University Academic Field of Medicine, Dentistry, and Pharmaceutical Science, 2-5-1 Shikata, Okayama, 700-8558, Japan
| | - Masato Yashiro
- Department of Pediatrics, Okayama University Hospital, 2-5-1 Shikata, Okayama, 700-8558, Japan
| | - Hirokazu Tsukahara
- Department of Pediatrics, Okayama University Graduate School of Medicine, Dentistry, and Pharmaceutical Sciences, 2-5-1 Shikata, Okayama, 700-8558, Japan
| |
Collapse
|
4
|
AlRyalat SA, Al Oweidat K, Al-Essa M, Ashouri K, El Khatib O, Al-Rawashdeh A, Yaseen A, Toumar A, Alrwashdeh A. Influenza Altmetric Attention Score and its association with the influenza season in the USA. F1000Res 2022; 9:96. [PMID: 35465063 PMCID: PMC9021684 DOI: 10.12688/f1000research.22127.3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Accepted: 03/04/2022] [Indexed: 11/20/2022] Open
Abstract
Background: Altmetrics measure the impact of journal articles by tracking social media, Wikipedia, public policy documents, blogs, and mainstream news activity, after which an overall Altmetric attention score (AAS) is calculated for every journal article. In this study, we aim to assess the AAS for influenza related articles and its relation to the influenza season in the USA. Methods: This study used the openly available Altmetric data from Altmetric.com. First, we retrieved all influenza-related articles using an advanced PubMed search query, then we inputted the resulted query into Altmetric explorer. We then calculated the average AAS for each month during the years 2012-2018. Results: A total of 24,964 PubMed documents were extracted, among them, 12,395 documents had at least one attention. We found a significant difference in mean AAS between February and each of January and March (p< 0.001, mean difference of 117.4 and 460.7, respectively). We found a significant difference between June and each of May and July (p< 0.001, mean difference of 1221.4 and 162.7, respectively). We also found a significant difference between October and each of September and November (p< 0.001, mean difference of 88.8 and 154.8, respectively). Conclusion: We observed a seasonal trend in the attention toward influenza-related research, with three annual peaks that correlated with the beginning, peak, and end of influenza seasons in the USA, according to Centers for Disease Control and Prevention (CDC) data.
Collapse
|
5
|
Wang MY, Tang NJ. The correlation between Google trends and salmonellosis. BMC Public Health 2021; 21:1575. [PMID: 34416859 PMCID: PMC8379030 DOI: 10.1186/s12889-021-11615-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2020] [Accepted: 07/29/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Salmonella infection (salmonellosis) is a common infectious disease leading to gastroenteritis, dehydration, uveitis, etc. Internet search is a new method to monitor the outbreak of infectious disease. An internet-based surveillance system using internet data is logistically advantageous and economical to show term-related diseases. In this study, we tried to determine the relationship between salmonellosis and Google Trends in the USA from January 2004 to December 2017. METHODS We downloaded the reported salmonellosis in the USA from the National Outbreak Reporting System (NORS) from January 2004 to December 2017. Additionally, we downloaded the Google search terms related to salmonellosis from Google Trends in the same period. Cross-correlation analysis and multiple regression analysis were conducted. RESULTS The results showed that 6 Google Trends search terms appeared earlier than reported salmonellosis, 26 Google Trends search terms coincided with salmonellosis, and 16 Google Trends search terms appeared after salmonellosis were reported. When the search terms preceded outbreaks, "foods" (t = 2.927, P = 0.004) was a predictor of salmonellosis. When the search terms coincided with outbreaks, "hotel" (t = 1.854, P = 0.066), "poor sanitation" (t = 2.895, P = 0.004), "blueberries" (t = 2.441, P = 0.016), and "hypovolemic shock" (t = 2.001, P = 0.047) were predictors of salmonellosis. When the search terms appeared after outbreaks, "ice cream" (t = 3.077, P = 0.002) was the predictor of salmonellosis. Finally, we identified the most important indicators of Google Trends search terms, including "hotel" (t = 1.854, P = 0.066), "poor sanitation" (t = 2.895, P = 0.004), "blueberries" (t = 2.441, P = 0.016), and "hypovolemic shock" (t = 2.001, P = 0.047). In the future, the increased search activities of these terms might indicate the salmonellosis. CONCLUSION We evaluated the related Google Trends search terms with salmonellosis and identified the most important predictors of salmonellosis outbreak.
Collapse
Affiliation(s)
- Ming-Yang Wang
- Department of Occupational and Environmental Health, School of Public Health, Tianjin Medical University, Tianjin, 300070, China.,Tianjin Key Laboratory of Environment, Nutrition, and Public Health, Tianjin Medical University, Tianjin, 300070, China.,Beijing Tongren Eye Center, Beijing Ophthalmology& Visual Sciences Key Laboratory, Beijing Tongren Hospital Affiliated to Capital University of Medical Sciences, Beijing, 100730, China
| | - Nai-Jun Tang
- Department of Occupational and Environmental Health, School of Public Health, Tianjin Medical University, Tianjin, 300070, China. .,Tianjin Key Laboratory of Environment, Nutrition, and Public Health, Tianjin Medical University, Tianjin, 300070, China.
| |
Collapse
|
6
|
Wang S, Liu Z, Tong M, Xiang J, Zhang Y, Gao Q, Zhang Y, Lu L, Jiang B, Bi P. Real-time forecasting and early warning of bacillary dysentery activity in four meteorological and geographic divisions in China. THE SCIENCE OF THE TOTAL ENVIRONMENT 2021; 761:144093. [PMID: 33360132 DOI: 10.1016/j.scitotenv.2020.144093] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Revised: 11/08/2020] [Accepted: 11/20/2020] [Indexed: 06/12/2023]
Abstract
BACKGROUND Accurate and timely forecasts of bacillary dysentery (BD) incidence can be used to inform public health decision-making and response preparedness. However, our ability to detect BD dynamics and outbreaks remains limited in China. OBJECTIVES This study aims to explore the impacts of meteorological factors on BD transmission in four representative regions in China and to forecast weekly number of BD cases and outbreaks. METHODS Weekly BD and meteorological data from 2014 to 2016 were collected for Beijing (Northern China), Shenyang (Northeast China), Chongqing (Southwest China) and Shenzhen (Southern China). A boosted regression tree (BRT) model was conducted to assess the impacts of meteorological factors on BD transmission. Then a real-time forecast and early warning model based on BRT was developed to track the dynamics of BD and detect the outbreaks. The forecasting methodology was compared with generalized additive model (GAM) and seasonal autoregressive integrated moving average model (SARIMA) that have been used to model the BD case data previously. RESULTS Ambient temperature was the most important meteorological factor contributing to the transmission of BD (80.81%-92.60%). A positive effect of temperature was observed when weekly mean temperature exceeded 4 °C, -3 °C, 9 °C and 16 °C in Beijing (Northern China), Shenyang (Northeast China), Chongqing (Southwest China) and Shenzhen (Southern China), respectively. BD incidence (Beijing and Shenyang) in temperate cities was more sensitive to high temperature than that in subtropical cities (Chongqing and Shenzhen). The dynamics and outbreaks of BD can be accurately forecasted and detected by the BRT model. Compared to GAM and SARIMA, BRT model showed more accurate forecasting for 1-, 2-, 3-weeks ahead forecasts in Beijing, Shenyang and Shenzhen. CONCLUSIONS Temperature plays the most important role in weather-attributable BD transmission. The BRT model achieved a better performance in comparison with GAM and SARIMA in most study cities, which could be used as a more accurate tool for forecasting and outbreak alert of BD in China.
Collapse
Affiliation(s)
- Shuzi Wang
- Department of Epidemiology, School of Public Health, Cheeloo College of Medicine, Shandong University, Jinan 250012, Shandong, China; Shandong University Climate Change and Health Center, Jinan 250012, Shandong, China
| | - Zhidong Liu
- Qilu Hospital, Cheeloo College of Medicine, Shandong University, Jinan 250012, Shandong, China; Shandong University Climate Change and Health Center, Jinan 250012, Shandong, China
| | - Michael Tong
- School of Public Health, The University of Adelaide, Adelaide, South Australia, Australia
| | - Jianjun Xiang
- School of Public Health, Fujian Medical University, Fuzhou 350121, Fujian, China; School of Public Health, The University of Adelaide, Adelaide, South Australia, Australia
| | - Ying Zhang
- School of Public Health, China Studies Centre, The University of Sydney, New South Wales, Australia
| | - Qi Gao
- Department of Epidemiology, School of Public Health, Cheeloo College of Medicine, Shandong University, Jinan 250012, Shandong, China; Shandong University Climate Change and Health Center, Jinan 250012, Shandong, China
| | - Yiwen Zhang
- Department of Epidemiology, School of Public Health, Cheeloo College of Medicine, Shandong University, Jinan 250012, Shandong, China; Shandong University Climate Change and Health Center, Jinan 250012, Shandong, China
| | - Liang Lu
- State Key Laboratory of Infectious Disease Prevention and Control, National Institute for Communicable Disease Control and Prevention, Chinese Center for Disease Control and Prevention, Beijing 102206, China; Shandong University Climate Change and Health Center, Jinan 250012, Shandong, China
| | - Baofa Jiang
- Department of Epidemiology, School of Public Health, Cheeloo College of Medicine, Shandong University, Jinan 250012, Shandong, China; Shandong University Climate Change and Health Center, Jinan 250012, Shandong, China.
| | - Peng Bi
- School of Public Health, The University of Adelaide, Adelaide, South Australia, Australia
| |
Collapse
|
7
|
Scarpino SV, Scott JG, Eggo RM, Clements B, Dimitrov NB, Meyers LA. Socioeconomic bias in influenza surveillance. PLoS Comput Biol 2020; 16:e1007941. [PMID: 32644990 PMCID: PMC7347107 DOI: 10.1371/journal.pcbi.1007941] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2018] [Accepted: 05/11/2020] [Indexed: 11/18/2022] Open
Abstract
Individuals in low socioeconomic brackets are considered at-risk for developing influenza-related complications and often exhibit higher than average influenza-related hospitalization rates. This disparity has been attributed to various factors, including restricted access to preventative and therapeutic health care, limited sick leave, and household structure. Adequate influenza surveillance in these at-risk populations is a critical precursor to accurate risk assessments and effective intervention. However, the United States of America's primary national influenza surveillance system (ILINet) monitors outpatient healthcare providers, which may be largely inaccessible to lower socioeconomic populations. Recent initiatives to incorporate Internet-source and hospital electronic medical records data into surveillance systems seek to improve the timeliness, coverage, and accuracy of outbreak detection and situational awareness. Here, we use a flexible statistical framework for integrating multiple surveillance data sources to evaluate the adequacy of traditional (ILINet) and next generation (BioSense 2.0 and Google Flu Trends) data for situational awareness of influenza across poverty levels. We find that ZIP Codes in the highest poverty quartile are a critical vulnerability for ILINet that the integration of next generation data fails to ameliorate.
Collapse
Affiliation(s)
- Samuel V. Scarpino
- Network Science Institute, Northeastern University, Boston, Massachusetts, United States of America
- Marine & Environmental Sciences, Northeastern University, Boston, Massachusetts, United States of America
- Physics, Northeastern University, Boston, Massachusetts, United States of America
- Health Sciences, Northeastern University, Boston, Massachusetts, United States of America
- ISI Foundation, Turin, Italy
| | - James G. Scott
- Department of Statistics and Data Sciences, The University of Texas at Austin, Austin, Texas, United States of America
| | - Rosalind M. Eggo
- Department of Infectious Disease Epidemiology, London School of Hygiene and Tropical Medicine, London, United Kingdom
| | - Bruce Clements
- Pediatric Healthcare Connection, Austin, Texas, United States of America
| | - Nedialko B. Dimitrov
- Department of Operations Research, The University of Texas at Austin, Austin, Texas, United States of America
| | - Lauren Ancel Meyers
- Department of Integrative Biology, The University of Texas at Austin, Austin, Texas, United States of America
- Santa Fe Institute, Santa Fe, New Mexico, United States of America
| |
Collapse
|
8
|
Schneider PP, van Gool CJAW, Spreeuwenberg P, Hooiveld M, Donker GA, Barnett DJ, Paget J. Using web search queries to monitor influenza-like illness: an exploratory retrospective analysis, Netherlands, 2017/18 influenza season. Euro Surveill 2020; 25:1900221. [PMID: 32489174 PMCID: PMC7268271 DOI: 10.2807/1560-7917.es.2020.25.21.1900221] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022] Open
Abstract
BackgroundDespite the early development of Google Flu Trends in 2009, standards for digital epidemiology methods have not been established and research from European countries is scarce.AimIn this article, we study the use of web search queries to monitor influenza-like illness (ILI) rates in the Netherlands in real time.MethodsIn this retrospective analysis, we simulated the weekly use of a prediction model for estimating the then-current ILI incidence across the 2017/18 influenza season solely based on Google search query data. We used weekly ILI data as reported to The European Surveillance System (TESSY) each week, and we removed the then-last 4 weeks from our dataset. We then fitted a prediction model based on the then-most-recent search query data from Google Trends to fill the 4-week gap ('Nowcasting'). Lasso regression, in combination with cross-validation, was applied to select predictors and to fit the 52 models, one for each week of the season.ResultsThe models provided accurate predictions with a mean and maximum absolute error of 1.40 (95% confidence interval: 1.09-1.75) and 6.36 per 10,000 population. The onset, peak and end of the epidemic were predicted with an error of 1, 3 and 2 weeks, respectively. The number of search terms retained as predictors ranged from three to five, with one keyword, 'griep' ('flu'), having the most weight in all models.DiscussionThis study demonstrates the feasibility of accurate, real-time ILI incidence predictions in the Netherlands using Google search query data.
Collapse
Affiliation(s)
- Paul P Schneider
- School of Health and Related Research (ScHARR), University of Sheffield, Sheffield, United Kingdom,Nivel (Netherlands Institute for Health Service Research), Utrecht, Netherlands
| | - Christel JAW van Gool
- School CAPHRI, Care and Public Health Research Institute, Maastricht University, Maastricht, Netherlands
| | - Peter Spreeuwenberg
- Nivel (Netherlands Institute for Health Service Research), Utrecht, Netherlands
| | - Mariëtte Hooiveld
- Nivel (Netherlands Institute for Health Service Research), Utrecht, Netherlands
| | - Gé A Donker
- Nivel (Netherlands Institute for Health Service Research), Utrecht, Netherlands
| | - David J Barnett
- Faculty of Health, Medicine and Life Sciences, Maastricht University, Maastricht, Netherlands
| | - John Paget
- Nivel (Netherlands Institute for Health Service Research), Utrecht, Netherlands
| |
Collapse
|
9
|
Samaras L, García-Barriocanal E, Sicilia MA. Syndromic surveillance using web data: a systematic review. INNOVATION IN HEALTH INFORMATICS 2020. [PMCID: PMC7153324 DOI: 10.1016/b978-0-12-819043-2.00002-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
Abstract
During the recent years, a lot of debate is taken place about the evolution of Smart Healthcare systems. Particularly, how these systems can help people improve human conditions of health, by taking advantages of the new Information and Communication Technologies (ICT), regarding early prediction and efficient treatment. The purpose of this study is to provide a systematic review of the current literature available that focuses on information systems on syndromic surveillance using web data. All published items concern articles, books, reviews, reports, conference announcements, and dissertations. We used a variation of PRISMA Statements methodology to conduct a systematic review. The review identifies the relevant published papers from the year 2004 to 2018, systematically includes and explores them to extract similarities, gaps, and conclusions on the research that has been done so far. The results presented concern the year, the examined disease, the web data source, the geographic location/country, and the data analysis method used. The results show that influenza is the most examined infectious disease. The internet tools most used are Twitter and Google. Regarding the geographical areas explored in the published papers, the most examined country is the United States, since many scientists come from this country. There is a significant growth of articles since 2009. There are also various statistical methods used to correlate the data retrieved from the internet to the data from national authorities. The conclusion of all researches is that the Web can be a useful tool for the detection of serious epidemics and for a creation of a syndromic surveillance system using the Web, since we can predict epidemics from web data before they are officially detected in population. With the advance of ICT, Smart Healthcare can benefit from the monitoring of epidemics and the early prediction of such a system, improving national or international health strategies and policy decision. This can be achieved through the provision of new technology tools to enhance health monitoring systems toward the new innovations of Smart Health or eHealth, even with the emerging technologies of Internet of Things. The challenges and impacts of an electronic system based on internet data include the social, medical, and technological disciplines. These can be further extended to Smart Healthcare, as the data streaming can provide with real-time information, awareness on epidemics and alerts for both patients or medical scientists. Finally, these new systems can help improve the standards of human life.
Collapse
|
10
|
Using Google Trends to understand information-seeking behaviour about throat cancer. The Journal of Laryngology & Otology 2019; 133:610-614. [PMID: 31280728 DOI: 10.1017/s0022215119001348] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
OBJECTIVE Many people seek health information from internet sources. Understanding this behaviour can help inform healthcare delivery. This study aimed to review Google Trends as a method for investigating internet-based information-seeking behaviour related to throat cancer in terms of quantity, content and thematic analysis. METHOD Data was collected using Google Trends. Normalised data was created using the search terms 'throat cancer', 'cancer', 'HPV', 'laryngeal cancer' and 'head and neck cancer'. The search data was used to analyse the temporal and geographical interest pattern of these terms from 2004 to 2015. RESULTS Three important peaks in searches for 'throat cancer' were identified. The first and greatest increase in interest was in September 2010, and there were also peaks in June 2013 and in October 2011. CONCLUSION Internet-search analysis can provide an insight into the information-seeking behaviour of the public. Mass media can hugely affect this information-seeking behaviour. Possessing tools to investigate and understand information-seeking behaviour may be used to improve healthcare delivery.
Collapse
|
11
|
Şimşek AÇ, Akdoğan D. Evaluation of Sentinel Influenza Like Illness (ILI) Surveillance Between The 40th Week of The Ankara Province in 2017 and The 20th Week of 2018. ANKARA MEDICAL JOURNAL 2019. [DOI: 10.17098/amj.570946] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022] Open
|
12
|
Metagenomic analysis of viruses in toilet waste from long distance flights-A new procedure for global infectious disease surveillance. PLoS One 2019; 14:e0210368. [PMID: 30640944 PMCID: PMC6331095 DOI: 10.1371/journal.pone.0210368] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2018] [Accepted: 12/20/2018] [Indexed: 01/01/2023] Open
Abstract
Human viral pathogens are a major public health threat. Reliable information that accurately describes and characterizes the global occurrence and transmission of human viruses is essential to support national and global priority setting, public health actions, and treatment decisions. However, large areas of the globe are currently without surveillance due to limited health care infrastructure and lack of international cooperation. We propose a novel surveillance strategy, using metagenomic analysis of toilet material from international air flights as a method for worldwide viral disease surveillance. The aim of this study was to design, implement, and evaluate a method for viral analysis of airplane toilet waste enabling simultaneous detection and quantification of a wide range of human viral pathogens. Toilet waste from 19 international airplanes was analyzed for viral content, using viral capture probes followed by high-throughput sequencing. Numerous human pathogens were detected including enteric and respiratory viruses. Several geographic trends were observed with samples originating from South Asia having significantly higher viral species richness as well as higher abundances of salivirus A, aichivirus A and enterovirus B, compared to samples originating from North Asia and North America. In addition, certain city specific trends were observed, including high numbers of rotaviruses in airplanes departing from Islamabad. Based on this study we believe that central sampling and analysis at international airports could be a useful supplement for global viral surveillance, valuable for outbreak detection and for guiding public health resources.
Collapse
|
13
|
Ertem Z, Raymond D, Meyers LA. Optimal multi-source forecasting of seasonal influenza. PLoS Comput Biol 2018; 14:e1006236. [PMID: 30180212 PMCID: PMC6138397 DOI: 10.1371/journal.pcbi.1006236] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2018] [Revised: 09/14/2018] [Accepted: 05/28/2018] [Indexed: 11/18/2022] Open
Abstract
Forecasting the emergence and spread of influenza viruses is an important public health challenge. Timely and accurate estimates of influenza prevalence, particularly of severe cases requiring hospitalization, can improve control measures to reduce transmission and mortality. Here, we extend a previously published machine learning method for influenza forecasting to integrate multiple diverse data sources, including traditional surveillance data, electronic health records, internet search traffic, and social media activity. Our hierarchical framework uses multi-linear regression to combine forecasts from multiple data sources and greedy optimization with forward selection to sequentially choose the most predictive combinations of data sources. We show that the systematic integration of complementary data sources can substantially improve forecast accuracy over single data sources. When forecasting the Center for Disease Control and Prevention (CDC) influenza-like-illness reports (ILINet) from week 48 through week 20, the optimal combination of predictors includes public health surveillance data and commercially available electronic medical records, but neither search engine nor social media data.
Collapse
Affiliation(s)
- Zeynep Ertem
- Department of Statistics and Data Science, The University of Texas at Austin, Austin, Texas, United States of America
- * E-mail:
| | - Dorrie Raymond
- athenaResearch, Watertown, Massachusetts, United States of America
| | - Lauren Ancel Meyers
- Departments of Integrative Biology and Statistics and Data Science, The University of Texas at Austin, Austin, Texas, United States of America
- The Santa Fe Institute, Santa Fe, New Mexico, United States of America
| |
Collapse
|
14
|
Zhou X, Yang F, Feng Y, Li Q, Tang F, Hu S, Lin Z, Zhang L. A Spatial-Temporal Method to Detect Global Influenza Epidemics Using Heterogeneous Data Collected from the Internet. IEEE/ACM TRANSACTIONS ON COMPUTATIONAL BIOLOGY AND BIOINFORMATICS 2018; 15:802-812. [PMID: 28391203 DOI: 10.1109/tcbb.2017.2690631] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
The 2009 influenza pandemic teaches us how fast the influenza virus could spread globally within a short period of time. To address the challenge of timely global influenza surveillance, this paper presents a spatial-temporal method that incorporates heterogeneous data collected from the Internet to detect influenza epidemics in real time. Specifically, the influenza morbidity data, the influenza-related Google query data and news data, and the international air transportation data are integrated in a multivariate hidden Markov model, which is designed to describe the intrinsic temporal-geographical correlation of influenza transmission for surveillance purpose. Respective models are built for 106 countries and regions in the world. Despite that the WHO morbidity data are not always available for most countries, the proposed method achieves 90.26 to 97.10 percent accuracy on average for real-time detection of global influenza epidemics during the period from January 2005 to December 2015. Moreover, experiment shows that, the proposed method could even predict an influenza epidemic before it occurs with 89.20 percent accuracy on average. Timely international surveillance results may help the authorities to prevent and control the influenza disease at the early stage of a global influenza pandemic.
Collapse
|
15
|
Wang J, Zhang T, Lu Y, Zhou G, Chen Q, Niu B. Vesicular stomatitis forecasting based on Google Trends. PLoS One 2018; 13:e0192141. [PMID: 29385198 PMCID: PMC5792013 DOI: 10.1371/journal.pone.0192141] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2017] [Accepted: 01/17/2018] [Indexed: 01/28/2023] Open
Abstract
Background Vesicular stomatitis (VS) is an important viral disease of livestock. The main feature of VS is irregular blisters that occur on the lips, tongue, oral mucosa, hoof crown and nipple. Humans can also be infected with vesicular stomatitis and develop meningitis. This study analyses 2014 American VS outbreaks in order to accurately predict vesicular stomatitis outbreak trends. Methods American VS outbreaks data were collected from OIE. The data for VS keywords were obtained by inputting 24 disease-related keywords into Google Trends. After calculating the Pearson and Spearman correlation coefficients, it was found that there was a relationship between outbreaks and keywords derived from Google Trends. Finally, the predicted model was constructed based on qualitative classification and quantitative regression. Results For the regression model, the Pearson correlation coefficients between the predicted outbreaks and actual outbreaks are 0.953 and 0.948, respectively. For the qualitative classification model, we constructed five classification predictive models and chose the best classification predictive model as the result. The results showed, SN (sensitivity), SP (specificity) and ACC (prediction accuracy) values of the best classification predictive model are 78.52%,72.5% and 77.14%, respectively. Conclusion This study applied Google search data to construct a qualitative classification model and a quantitative regression model. The results show that the method is effective and that these two models obtain more accurate forecast.
Collapse
Affiliation(s)
- JianYing Wang
- Shanghai Key Laboratory of Bio-Energy Crops, School of Life Sciences, Shanghai University, Shanghai, P. R. China
| | - Tong Zhang
- Shanghai Key Laboratory of Bio-Energy Crops, School of Life Sciences, Shanghai University, Shanghai, P. R. China
| | - Yi Lu
- Shanghai Key Laboratory of Bio-Energy Crops, School of Life Sciences, Shanghai University, Shanghai, P. R. China
| | - GuangYa Zhou
- Shanghai Key Laboratory of Bio-Energy Crops, School of Life Sciences, Shanghai University, Shanghai, P. R. China
| | - Qin Chen
- Shanghai Key Laboratory of Bio-Energy Crops, School of Life Sciences, Shanghai University, Shanghai, P. R. China
- * E-mail: (QC); (BN)
| | - Bing Niu
- Shanghai Key Laboratory of Bio-Energy Crops, School of Life Sciences, Shanghai University, Shanghai, P. R. China
- * E-mail: (QC); (BN)
| |
Collapse
|
16
|
Guo P, Liu T, Zhang Q, Wang L, Xiao J, Zhang Q, Luo G, Li Z, He J, Zhang Y, Ma W. Developing a dengue forecast model using machine learning: A case study in China. PLoS Negl Trop Dis 2017; 11:e0005973. [PMID: 29036169 PMCID: PMC5658193 DOI: 10.1371/journal.pntd.0005973] [Citation(s) in RCA: 87] [Impact Index Per Article: 10.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/16/2017] [Revised: 10/26/2017] [Accepted: 09/18/2017] [Indexed: 02/05/2023] Open
Abstract
BACKGROUND In China, dengue remains an important public health issue with expanded areas and increased incidence recently. Accurate and timely forecasts of dengue incidence in China are still lacking. We aimed to use the state-of-the-art machine learning algorithms to develop an accurate predictive model of dengue. METHODOLOGY/PRINCIPAL FINDINGS Weekly dengue cases, Baidu search queries and climate factors (mean temperature, relative humidity and rainfall) during 2011-2014 in Guangdong were gathered. A dengue search index was constructed for developing the predictive models in combination with climate factors. The observed year and week were also included in the models to control for the long-term trend and seasonality. Several machine learning algorithms, including the support vector regression (SVR) algorithm, step-down linear regression model, gradient boosted regression tree algorithm (GBM), negative binomial regression model (NBM), least absolute shrinkage and selection operator (LASSO) linear regression model and generalized additive model (GAM), were used as candidate models to predict dengue incidence. Performance and goodness of fit of the models were assessed using the root-mean-square error (RMSE) and R-squared measures. The residuals of the models were examined using the autocorrelation and partial autocorrelation function analyses to check the validity of the models. The models were further validated using dengue surveillance data from five other provinces. The epidemics during the last 12 weeks and the peak of the 2014 large outbreak were accurately forecasted by the SVR model selected by a cross-validation technique. Moreover, the SVR model had the consistently smallest prediction error rates for tracking the dynamics of dengue and forecasting the outbreaks in other areas in China. CONCLUSION AND SIGNIFICANCE The proposed SVR model achieved a superior performance in comparison with other forecasting techniques assessed in this study. The findings can help the government and community respond early to dengue epidemics.
Collapse
Affiliation(s)
- Pi Guo
- Department of Preventive Medicine, Shantou University Medical College, Shantou, China
| | - Tao Liu
- Guangdong Provincial Institute of Public Health, Guangdong Provincial Center for Disease Control and Prevention, Guangzhou, China
| | - Qin Zhang
- Good Clinical Practice Office, Cancer Hospital of Shantou University Medical College, Shantou, China
| | - Li Wang
- Department of Preventive Medicine, Shantou University Medical College, Shantou, China
| | - Jianpeng Xiao
- Guangdong Provincial Institute of Public Health, Guangdong Provincial Center for Disease Control and Prevention, Guangzhou, China
| | - Qingying Zhang
- Department of Preventive Medicine, Shantou University Medical College, Shantou, China
| | - Ganfeng Luo
- Department of Preventive Medicine, Shantou University Medical College, Shantou, China
| | - Zhihao Li
- Guangdong Provincial Institute of Public Health, Guangdong Provincial Center for Disease Control and Prevention, Guangzhou, China
| | - Jianfeng He
- Guangdong Provincial Center for Disease Control and Prevention, Guangzhou, China
| | - Yonghui Zhang
- Guangdong Provincial Center for Disease Control and Prevention, Guangzhou, China
| | - Wenjun Ma
- Guangdong Provincial Institute of Public Health, Guangdong Provincial Center for Disease Control and Prevention, Guangzhou, China
- * E-mail:
| |
Collapse
|
17
|
Xia S, Zhou XN, Liu J. Systems thinking in combating infectious diseases. Infect Dis Poverty 2017; 6:144. [PMID: 28893320 PMCID: PMC5594605 DOI: 10.1186/s40249-017-0339-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/27/2016] [Accepted: 07/26/2017] [Indexed: 12/18/2022] Open
Abstract
The transmission of infectious diseases is a dynamic process determined by multiple factors originating from disease pathogens and/or parasites, vector species, and human populations. These factors interact with each other and demonstrate the intrinsic mechanisms of the disease transmission temporally, spatially, and socially. In this article, we provide a comprehensive perspective, named as systems thinking, for investigating disease dynamics and associated impact factors, by means of emphasizing the entirety of a system’s components and the complexity of their interrelated behaviors. We further develop the general steps for performing systems approach to tackling infectious diseases in the real-world settings, so as to expand our abilities to understand, predict, and mitigate infectious diseases.
Collapse
Affiliation(s)
- Shang Xia
- National Institute of Parasitic Diseases, Chinese Center for Disease Control and Prevention, Shanghai, 200025, People's Republic of China.,Key Laboratory of Parasite and Vector Biology, National Health and Family Planning Commission, Shanghai, 200025, People's Republic of China.,WHO Collaborating Centre for Tropical Diseases, Shanghai, 200025, People's Republic of China.,CDC-NIPD & HKBU-CSD Joint Research Laboratory for Intelligent Disease Surveillance and Control, Shanghai, 200025, People's Republic of China
| | - Xiao-Nong Zhou
- National Institute of Parasitic Diseases, Chinese Center for Disease Control and Prevention, Shanghai, 200025, People's Republic of China.,Key Laboratory of Parasite and Vector Biology, National Health and Family Planning Commission, Shanghai, 200025, People's Republic of China.,WHO Collaborating Centre for Tropical Diseases, Shanghai, 200025, People's Republic of China.,CDC-NIPD & HKBU-CSD Joint Research Laboratory for Intelligent Disease Surveillance and Control, Shanghai, 200025, People's Republic of China
| | - Jiming Liu
- Department of Computer Science, Hong Kong Baptist University, Kowloon Tong, Hong Kong. .,CDC-NIPD & HKBU-CSD Joint Research Laboratory for Intelligent Disease Surveillance and Control, Shanghai, 200025, People's Republic of China.
| |
Collapse
|
18
|
Tran US, Andel R, Niederkrotenthaler T, Till B, Ajdacic-Gross V, Voracek M. Low validity of Google Trends for behavioral forecasting of national suicide rates. PLoS One 2017; 12:e0183149. [PMID: 28813490 PMCID: PMC5558943 DOI: 10.1371/journal.pone.0183149] [Citation(s) in RCA: 66] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/21/2016] [Accepted: 07/30/2017] [Indexed: 11/18/2022] Open
Abstract
Recent research suggests that search volumes of the most popular search engine worldwide, Google, provided via Google Trends, could be associated with national suicide rates in the USA, UK, and some Asian countries. However, search volumes have mostly been studied in an ad hoc fashion, without controls for spurious associations. This study evaluated the validity and utility of Google Trends search volumes for behavioral forecasting of suicide rates in the USA, Germany, Austria, and Switzerland. Suicide-related search terms were systematically collected and respective Google Trends search volumes evaluated for availability. Time spans covered 2004 to 2010 (USA, Switzerland) and 2004 to 2012 (Germany, Austria). Temporal associations of search volumes and suicide rates were investigated with time-series analyses that rigorously controlled for spurious associations. The number and reliability of analyzable search volume data increased with country size. Search volumes showed various temporal associations with suicide rates. However, associations differed both across and within countries and mostly followed no discernable patterns. The total number of significant associations roughly matched the number of expected Type I errors. These results suggest that the validity of Google Trends search volumes for behavioral forecasting of national suicide rates is low. The utility and validity of search volumes for the forecasting of suicide rates depend on two key assumptions ("the population that conducts searches consists mostly of individuals with suicidal ideation", "suicide-related search behavior is strongly linked with suicidal behavior"). We discuss strands of evidence that these two assumptions are likely not met. Implications for future research with Google Trends in the context of suicide research are also discussed.
Collapse
Affiliation(s)
- Ulrich S. Tran
- Department of Basic Psychological Research and Research Methods, School of Psychology, University of Vienna, Vienna, Austria
- Wiener Werkstaette for Suicide Research, Vienna, Austria
| | - Rita Andel
- Department of Basic Psychological Research and Research Methods, School of Psychology, University of Vienna, Vienna, Austria
- Wiener Werkstaette for Suicide Research, Vienna, Austria
| | - Thomas Niederkrotenthaler
- Wiener Werkstaette for Suicide Research, Vienna, Austria
- Suicide Research Unit, Department of Social and Preventive Medicine, Center for Public Health, Medical University of Vienna, Vienna, Austria
| | - Benedikt Till
- Wiener Werkstaette for Suicide Research, Vienna, Austria
- Suicide Research Unit, Department of Social and Preventive Medicine, Center for Public Health, Medical University of Vienna, Vienna, Austria
| | | | - Martin Voracek
- Department of Basic Psychological Research and Research Methods, School of Psychology, University of Vienna, Vienna, Austria
- Wiener Werkstaette for Suicide Research, Vienna, Austria
| |
Collapse
|
19
|
Burns SM, Turner DP, Sexton KE, Deng H, Houle TT. Using Search Engines to Investigate Shared Migraine Experiences. Headache 2017; 57:1217-1227. [PMID: 28660638 DOI: 10.1111/head.13130] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2017] [Revised: 04/19/2017] [Accepted: 04/20/2017] [Indexed: 12/01/2022]
Abstract
OBJECTIVES To investigate migraine patterns in the United States using Google search data and utilize this information to better understand societal-level trends. Additionally, we aimed to evaluate time-series relationships between migraines and social factors. BACKGROUND Extensive research has been done on clinical factors associated with migraines, yet population-level social factors have not been widely explored. Migraine internet search data may provide insight into migraine trends beyond information that can be gleaned from other sources. METHODS In this longitudinal analysis of open access data, we performed a time-series analysis in which about 12 years of Google Trends data (January 1, 2004 to August 15, 2016) were assessed. Data points were captured at a daily level and Google's 0-100 adjusted scale was used as the primary outcome to enable the comparison of relative popularity in the migraine search term. We hypothesized that the volume of relative migraine Google searches would be affected by societal aspects such as day of the week, holidays, and novel social events. RESULTS Several recurrent social factors that drive migraine searches were identified. Of these, day of the week had the most significant impact on the volume of Google migraine searches. On average, Mondays accumulated 13.31 higher relative search volume than Fridays (95% CI: 11.12-15.51, P ≤ .001). Surprisingly, holidays were associated with lower relative migraine search volumes. Christmas Day had 13.84 lower relative search volumes (95% CI: 6.26-21.43, P ≤ .001) and Thanks giving had 20.18 lower relative search volumes (95% CI: 12.55-27.82, P ≤ .001) than days that were not holidays. Certain novel social events and extreme weather also appear to be associated with relative migraine Google search volume. CONCLUSIONS Social factors play a crucial role in explaining population level migraine patterns, and thus, warrant further exploration.
Collapse
Affiliation(s)
- Sara M Burns
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Dana P Turner
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Katherine E Sexton
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Hao Deng
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| | - Timothy T Houle
- Department of Anesthesia, Critical Care and Pain Medicine, Massachusetts General Hospital, Harvard Medical School, Boston, MA
| |
Collapse
|
20
|
Guo P, Zhang J, Wang L, Yang S, Luo G, Deng C, Wen Y, Zhang Q. Monitoring seasonal influenza epidemics by using internet search data with an ensemble penalized regression model. Sci Rep 2017; 7:46469. [PMID: 28422149 PMCID: PMC5396076 DOI: 10.1038/srep46469] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2016] [Accepted: 03/20/2017] [Indexed: 02/05/2023] Open
Abstract
Seasonal influenza epidemics cause serious public health problems in China. Search queries-based surveillance was recently proposed to complement traditional monitoring approaches of influenza epidemics. However, developing robust techniques of search query selection and enhancing predictability for influenza epidemics remains a challenge. This study aimed to develop a novel ensemble framework to improve penalized regression models for detecting influenza epidemics by using Baidu search engine query data from China. The ensemble framework applied a combination of bootstrap aggregating (bagging) and rank aggregation method to optimize penalized regression models. Different algorithms including lasso, ridge, elastic net and the algorithms in the proposed ensemble framework were compared by using Baidu search engine queries. Most of the selected search terms captured the peaks and troughs of the time series curves of influenza cases. The predictability of the conventional penalized regression models were improved by the proposed ensemble framework. The elastic net regression model outperformed the compared models, with the minimum prediction errors. We established a Baidu search engine queries-based surveillance model for monitoring influenza epidemics, and the proposed model provides a useful tool to support the public health response to influenza and other infectious diseases.
Collapse
Affiliation(s)
- Pi Guo
- Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, Guangdong, 515041, People’s Republic of China
| | - Jianjun Zhang
- Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, Guangdong, 515041, People’s Republic of China
| | - Li Wang
- Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, Guangdong, 515041, People’s Republic of China
| | - Shaoyi Yang
- Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, Guangdong, 515041, People’s Republic of China
| | - Ganfeng Luo
- Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, Guangdong, 515041, People’s Republic of China
| | - Changyu Deng
- Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, Guangdong, 515041, People’s Republic of China
| | - Ye Wen
- Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, Guangdong, 515041, People’s Republic of China
| | - Qingying Zhang
- Department of Preventive Medicine, Shantou University Medical College, No. 22 Xinling Road, Shantou, Guangdong, 515041, People’s Republic of China
| |
Collapse
|
21
|
Menachemi N, Rahurkar S, Rahurkar M. Using Web-Based Search Data to Study the Public's Reactions to Societal Events: The Case of the Sandy Hook Shooting. JMIR Public Health Surveill 2017; 3:e12. [PMID: 28336508 PMCID: PMC5383805 DOI: 10.2196/publichealth.6033] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2016] [Revised: 10/29/2016] [Accepted: 02/03/2017] [Indexed: 11/21/2022] Open
Abstract
Background Internet search is the most common activity on the World Wide Web and generates a vast amount of user-reported data regarding their information-seeking preferences and behavior. Although this data has been successfully used to examine outbreaks, health care utilization, and outcomes related to quality of care, its value in informing public health policy remains unclear. Objective The aim of this study was to evaluate the role of Internet search query data in health policy development. To do so, we studied the public’s reaction to a major societal event in the context of the 2012 Sandy Hook School shooting incident. Methods Query data from the Yahoo! search engine regarding firearm-related searches was analyzed to examine changes in user-selected search terms and subsequent websites visited for a period of 14 days before and after the shooting incident. Results A total of 5,653,588 firearm-related search queries were analyzed. In the after period, queries increased for search terms related to “guns” (+50.06%), “shooting incident” (+333.71%), “ammunition” (+155.14%), and “gun-related laws” (+535.47%). The highest increase (+1054.37%) in Web traffic was seen by news websites following “shooting incident” queries whereas searches for “guns” (+61.02%) and “ammunition” (+173.15%) resulted in notable increases in visits to retail websites. Firearm-related queries generally returned to baseline levels after approximately 10 days. Conclusions Search engine queries present a viable infodemiology metric on public reactions and subsequent behaviors to major societal events and could be used by policymakers to inform policy development.
Collapse
Affiliation(s)
- Nir Menachemi
- Richard M. Fairbanks School of Public HealthHealth Policy and ManagementIndiana University-IUPUIIndianapolis, INUnited States.,Regenstrief InstituteCenter for Biomedical InformaticsIndianapolis, INUnited States
| | - Saurabh Rahurkar
- Regenstrief InstituteCenter for Biomedical InformaticsIndianapolis, INUnited States
| | | |
Collapse
|
22
|
Dengue Baidu Search Index data can improve the prediction of local dengue epidemic: A case study in Guangzhou, China. PLoS Negl Trop Dis 2017; 11:e0005354. [PMID: 28263988 PMCID: PMC5354435 DOI: 10.1371/journal.pntd.0005354] [Citation(s) in RCA: 54] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2016] [Revised: 03/16/2017] [Accepted: 01/24/2017] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Dengue fever (DF) in Guangzhou, Guangdong province in China is an important public health issue. The problem was highlighted in 2014 by a large, unprecedented outbreak. In order to respond in a more timely manner and hence better control such potential outbreaks in the future, this study develops an early warning model that integrates internet-based query data into traditional surveillance data. METHODOLOGY AND PRINCIPAL FINDINGS A Dengue Baidu Search Index (DBSI) was collected from the Baidu website for developing a predictive model of dengue fever in combination with meteorological and demographic factors. Generalized additive models (GAM) with or without DBSI were established. The generalized cross validation (GCV) score and deviance explained indexes, intraclass correlation coefficient (ICC) and root mean squared error (RMSE), were respectively applied to measure the fitness and the prediction capability of the models. Our results show that the DBSI with one-week lag has a positive linear relationship with the local DF occurrence, and the model with DBSI (ICC:0.94 and RMSE:59.86) has a better prediction capability than the model without DBSI (ICC:0.72 and RMSE:203.29). CONCLUSIONS Our study suggests that a DSBI combined with traditional disease surveillance and meteorological data can improve the dengue early warning system in Guangzhou.
Collapse
|
23
|
A look back: investigating Google Flu Trends during the influenza A(H1N1)pdm09 pandemic in Canada, 2009-2010. Epidemiol Infect 2016; 145:420-423. [PMID: 27876098 DOI: 10.1017/s0950268816002636] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
|
24
|
Shin SY, Seo DW, An J, Kwak H, Kim SH, Gwack J, Jo MW. High correlation of Middle East respiratory syndrome spread with Google search and Twitter trends in Korea. Sci Rep 2016; 6:32920. [PMID: 27595921 PMCID: PMC5011762 DOI: 10.1038/srep32920] [Citation(s) in RCA: 68] [Impact Index Per Article: 7.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2015] [Accepted: 08/16/2016] [Indexed: 01/07/2023] Open
Abstract
The Middle East respiratory syndrome coronavirus (MERS-CoV) was exported to Korea in 2015, resulting in a threat to neighboring nations. We evaluated the possibility of using a digital surveillance system based on web searches and social media data to monitor this MERS outbreak. We collected the number of daily laboratory-confirmed MERS cases and quarantined cases from May 11, 2015 to June 26, 2015 using the Korean government MERS portal. The daily trends observed via Google search and Twitter during the same time period were also ascertained using Google Trends and Topsy. Correlations among the data were then examined using Spearman correlation analysis. We found high correlations (>0.7) between Google search and Twitter results and the number of confirmed MERS cases for the previous three days using only four simple keywords: "MERS", "" ("MERS (in Korean)"), "" ("MERS symptoms (in Korean)"), and "" ("MERS hospital (in Korean)"). Additionally, we found high correlations between the Google search and Twitter results and the number of quarantined cases using the above keywords. This study demonstrates the possibility of using a digital surveillance system to monitor the outbreak of MERS.
Collapse
Affiliation(s)
- Soo-Yong Shin
- Department of Biomedical Informatics, Asan Medical Center, Seoul, Korea
| | - Dong-Woo Seo
- Department of Emergency Medicine, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Jisun An
- Qatar Computing Research Institute, Hamad Bin Khalifa University, Doha, Qatar
| | - Haewoon Kwak
- Qatar Computing Research Institute, Hamad Bin Khalifa University, Doha, Qatar
| | - Sung-Han Kim
- Department of Infectious Diseases, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Jin Gwack
- Center for Disease Control and Prevention, Osong, Chungbuk, Korea
| | - Min-Woo Jo
- Department of Preventive Medicine, University of Ulsan College of Medicine, Seoul, Korea
| |
Collapse
|
25
|
Herrera JL, Srinivasan R, Brownstein JS, Galvani AP, Meyers LA. Disease Surveillance on Complex Social Networks. PLoS Comput Biol 2016; 12:e1004928. [PMID: 27415615 PMCID: PMC4944951 DOI: 10.1371/journal.pcbi.1004928] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2015] [Accepted: 04/19/2016] [Indexed: 11/18/2022] Open
Abstract
As infectious disease surveillance systems expand to include digital, crowd-sourced, and social network data, public health agencies are gaining unprecedented access to high-resolution data and have an opportunity to selectively monitor informative individuals. Contact networks, which are the webs of interaction through which diseases spread, determine whether and when individuals become infected, and thus who might serve as early and accurate surveillance sensors. Here, we evaluate three strategies for selecting sensors-sampling the most connected, random, and friends of random individuals-in three complex social networks-a simple scale-free network, an empirical Venezuelan college student network, and an empirical Montreal wireless hotspot usage network. Across five different surveillance goals-early and accurate detection of epidemic emergence and peak, and general situational awareness-we find that the optimal choice of sensors depends on the public health goal, the underlying network and the reproduction number of the disease (R0). For diseases with a low R0, the most connected individuals provide the earliest and most accurate information about both the onset and peak of an outbreak. However, identifying network hubs is often impractical, and they can be misleading if monitored for general situational awareness, if the underlying network has significant community structure, or if R0 is high or unknown. Taking a theoretical approach, we also derive the optimal surveillance system for early outbreak detection but find that real-world identification of such sensors would be nearly impossible. By contrast, the friends-of-random strategy offers a more practical and robust alternative. It can be readily implemented without prior knowledge of the network, and by identifying sensors with higher than average, but not the highest, epidemiological risk, it provides reasonably early and accurate information.
Collapse
Affiliation(s)
- Jose L. Herrera
- Department of Integrative Biology, The University of Texas at Austin, Austin, Texas, United States of America
- Departamento de Cálculo, Escuela Básica de Ingeniería, Facultad de Ingeneiría, Universidad de Los Andes, Mérida, Venezuela
- * E-mail:
| | - Ravi Srinivasan
- Applied Research Laboratories, The University of Texas at Austin, Austin, Texas, United States of America
- Department of Statistics and Data Sciences, The University of Texas at Austin, Austin, Texas, United States of America
| | - John S. Brownstein
- Department of Pediatrics, Harvard Medical School and Children’s Hospital Informatics Program, Boston Children’s Hospital, Boston, Massachusetts, United States of America
| | - Alison P. Galvani
- Center for Infectious Disease Modeling and Analysis, Yale School of Public Health, New Haven, Connecticut, United States of America
| | - Lauren Ancel Meyers
- Department of Integrative Biology, The University of Texas at Austin, Austin, Texas, United States of America
| |
Collapse
|
26
|
Correlation between National Influenza Surveillance Data and Search Queries from Mobile Devices and Desktops in South Korea. PLoS One 2016; 11:e0158539. [PMID: 27391028 PMCID: PMC4938422 DOI: 10.1371/journal.pone.0158539] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2015] [Accepted: 06/17/2016] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Digital surveillance using internet search queries can improve both the sensitivity and timeliness of the detection of a health event, such as an influenza outbreak. While it has recently been estimated that the mobile search volume surpasses the desktop search volume and mobile search patterns differ from desktop search patterns, the previous digital surveillance systems did not distinguish mobile and desktop search queries. The purpose of this study was to compare the performance of mobile and desktop search queries in terms of digital influenza surveillance. METHODS AND RESULTS The study period was from September 6, 2010 through August 30, 2014, which consisted of four epidemiological years. Influenza-like illness (ILI) and virologic surveillance data from the Korea Centers for Disease Control and Prevention were used. A total of 210 combined queries from our previous survey work were used for this study. Mobile and desktop weekly search data were extracted from Naver, which is the largest search engine in Korea. Spearman's correlation analysis was used to examine the correlation of the mobile and desktop data with ILI and virologic data in Korea. We also performed lag correlation analysis. We observed that the influenza surveillance performance of mobile search queries matched or exceeded that of desktop search queries over time. The mean correlation coefficients of mobile search queries and the number of queries with an r-value of ≥ 0.7 equaled or became greater than those of desktop searches over the four epidemiological years. A lag correlation analysis of up to two weeks showed similar trends. CONCLUSION Our study shows that mobile search queries for influenza surveillance have equaled or even become greater than desktop search queries over time. In the future development of influenza surveillance using search queries, the recognition of changing trend of mobile search data could be necessary.
Collapse
|
27
|
Orellano PW, Reynoso JI, Antman J, Argibay O. [Using Google Trends to estimate the incidence of influenza-like illness in Argentina]. CAD SAUDE PUBLICA 2015; 31:691-700. [PMID: 25945979 DOI: 10.1590/0102-311x00072814] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2014] [Accepted: 12/08/2014] [Indexed: 11/21/2022] Open
Abstract
The aim of this study was to find a model to estimate the incidence of influenza-like illness (ILI) from the Google Trends (GT) related to influenza. ILI surveillance data from 2012 through 2013 were obtained from the National Health Surveillance System, Argentina. Internet search data were downloaded from the GT search engine database using 6 influenza-related queries: flu, fever, cough, sore throat, paracetamol, and ibuprofen. A Poisson regression model was developed to compare surveillance data and internet search trends for the year 2012. The model's results were validated using surveillance data for the year 2013 and results of the Google Flu Trends (GFT) tool. ILI incidence from the surveillance system showed strong correlations with ILI estimates from the GT model (r = 0.927) and from the GFT tool (r = 0.943). However, the GFT tool overestimates (by nearly twofold) the highest ILI incidence, while the GT model underestimates the highest incidence by a factor of 0.7. These results demonstrate the utility of GT to complement influenza surveillance.
Collapse
|
28
|
Schanzer DL, Saboui M, Lee L, Domingo FR, Mersereau T. Leading Indicators and the Evaluation of the Performance of Alerts for Influenza Epidemics. PLoS One 2015; 10:e0141776. [PMID: 26513364 PMCID: PMC4626042 DOI: 10.1371/journal.pone.0141776] [Citation(s) in RCA: 8] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2015] [Accepted: 10/13/2015] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Most evaluations of epidemic thresholds for influenza have been limited to internal criteria of the indicator variable. We aimed to initiate discussion on appropriate methods for evaluation and the value of cross-validation in assessing the performance of a candidate indicator for influenza activity. METHODS Hospital records of in-patients with a diagnosis of confirmed influenza were extracted from the Canadian Discharge Abstract Database from 2003 to 2011 and aggregated to weekly and regional levels, yielding 7 seasons and 4 regions for evaluation (excluding the 2009 pandemic period). An alert created from the weekly time-series of influenza positive laboratory tests (FluWatch, Public Health Agency of Canada) was evaluated against influenza-confirmed hospitalizations on 5 criteria: lead/lag timing; proportion of influenza hospitalizations covered by the alert period; average length of the influenza alert period; continuity of the alert period and length of the pre-peak alert period. RESULTS Influenza hospitalizations led laboratory positive tests an average of only 1.6 (95% CI: -1.5, 4.7) days. However, the difference in timing exceeded 1 week and was statistically significant at the significance level of 0.01 in 5 out of 28 regional seasons. An alert based primarily on 5% positivity and 15 positive tests produced an average alert period of 16.6 weeks. After allowing for a reporting delay of 2 weeks, the alert period included 80% of all influenza-confirmed hospitalizations. For 20 out of the 28 (71%) seasons, the first alert would have been signalled at least 3 weeks (in real time) prior to the week with maximum number of influenza hospitalizations. CONCLUSIONS Virological data collected from laboratories was a good indicator of influenza activity with the resulting alert covering most influenza hospitalizations and providing a reasonable pre-peak warning at the regional level. Though differences in timing were statistically significant, neither time-series consistently led the other.
Collapse
Affiliation(s)
- Dena L. Schanzer
- Centre for Communicable Diseases and Infection Control, Infectious Disease Prevention and Control Branch, Public Health Agency of Canada, Ottawa, Ontario, Canada
| | - Myriam Saboui
- Centre for Immunization and Respiratory Infectious Diseases, Infectious Disease Prevention and Control Branch, Public Health Agency of Canada, Ottawa, Ontario, Canada
| | - Liza Lee
- Centre for Immunization and Respiratory Infectious Diseases, Infectious Disease Prevention and Control Branch, Public Health Agency of Canada, Ottawa, Ontario, Canada
| | - Francesca Reyes Domingo
- Centre for Immunization and Respiratory Infectious Diseases, Infectious Disease Prevention and Control Branch, Public Health Agency of Canada, Ottawa, Ontario, Canada
| | - Teresa Mersereau
- Centre for Immunization and Respiratory Infectious Diseases, Infectious Disease Prevention and Control Branch, Public Health Agency of Canada, Ottawa, Ontario, Canada
| |
Collapse
|
29
|
Houle JN, Collins JM, Schmeiser MD. Flu and Finances: Influenza Outbreaks and Loan Defaults in US Cities, 2004-2012. Am J Public Health 2015; 105:e75-80. [PMID: 26180971 DOI: 10.2105/ajph.2015.302671] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
OBJECTIVES We examined the association between influenza outbreaks in 83 metropolitan areas and credit card and mortgage defaults, as measured in quarterly zip code-level credit data over the period of 2004 to 2012. METHODS We used ordinary least squares, fixed effects, and 2-stage least squares instrumental variables regression strategies to examine the relationship between influenza-related Google searches and 30-, 60-, and 90-day credit card and mortgage delinquency rates. RESULTS We found that a proxy for influenza outbreaks is associated with a small but statistically significant increase in credit card and mortgage default rates, net of other factors. These effects are largest for 90-day defaults, suggesting that influenza outbreaks have a disproportionate impact on vulnerable borrowers who are already behind on their payments. CONCLUSIONS Overall, it appears there is a relationship between exogenous health shocks (such as influenza) and credit default. The results suggest that consumer finances could benefit from policies that aim to reduce the financial shocks of illness, particularly for vulnerable borrowers.
Collapse
Affiliation(s)
- Jason N Houle
- Jason N. Houle is with the Department of Sociology, Dartmouth College, Hanover, NH. J. Michael Collins is with School of Human Ecology and LaFollette School of Public Affairs at the University of Wisconsin-Madison. Maximilian D. Schmeiser is with the Microeconomic Surveys Section at the Federal Reserve Board, Washington, DC
| | - J Michael Collins
- Jason N. Houle is with the Department of Sociology, Dartmouth College, Hanover, NH. J. Michael Collins is with School of Human Ecology and LaFollette School of Public Affairs at the University of Wisconsin-Madison. Maximilian D. Schmeiser is with the Microeconomic Surveys Section at the Federal Reserve Board, Washington, DC
| | - Maximilian D Schmeiser
- Jason N. Houle is with the Department of Sociology, Dartmouth College, Hanover, NH. J. Michael Collins is with School of Human Ecology and LaFollette School of Public Affairs at the University of Wisconsin-Madison. Maximilian D. Schmeiser is with the Microeconomic Surveys Section at the Federal Reserve Board, Washington, DC
| |
Collapse
|
30
|
Google Flu Trends in Canada: a comparison of digital disease surveillance data with physician consultations and respiratory virus surveillance data, 2010-2014. Epidemiol Infect 2015; 144:325-32. [PMID: 26135239 DOI: 10.1017/s0950268815001478] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022] Open
Abstract
The value of Google Flu Trends (GFT) remains unclear after it overestimated the proportion of physician visits related to influenza-like illness (ILI) in the United States in 2012-2013. However, GFT estimates (%GFT) have not been examined nationally in Canada nor compared with positivity for respiratory viruses other than influenza. For 2010-2014, we compared %GFT for Canada to Public Health Agency of Canada ILI consultation rates (%PHAC) and to positivity for influenza A and B, respiratory syncytial virus (RSV), human metapneumovirus (hMPV), and rhinoviruses. %GFT correlated well with %PHAC (ρ = 0·77-0·90) and influenza A positivity (ρ = 0·64-0·96) and overestimated the 2012-2013 %PHAC peak by 0·99 percentage points. %GFT peaks corresponded temporally with peaks in positivity for influenza A and rhinoviruses (all seasons) and RSV and hMPV when their peaks preceded influenza peaks. In Canada, %GFT represented traditional surveillance data and corresponded temporally with patterns in circulating respiratory viruses.
Collapse
|
31
|
Affiliation(s)
- Viroj Wiwanitkit
- Surin Rajabhat University, Thailand; Wiwanitkit House, Thailand; Hainan Medical College, China
| |
Collapse
|
32
|
Köhler MJ, Springer S, Kaatz M. [On the seasonality of dermatoses: a retrospective analysis of search engine query data depending on the season]. Hautarzt 2015; 65:814-22. [PMID: 25234631 DOI: 10.1007/s00105-014-2848-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
BACKGROUND The volume of search engine queries about disease-relevant items reflects public interest and correlates with disease prevalence as proven by the example of flu (influenza). Other influences include media attention or holidays. STUDY GOAL The present work investigates if the seasonality of prevalence or symptom severity of dermatoses correlates with search engine query data. METHODS The relative weekly volume of dermatological relevant search terms was assessed by the online tool Google Trends for the years 2009-2013. For each item, the degree of seasonality was calculated via frequency analysis and a geometric approach. RESULTS Many dermatoses show a marked seasonality, reflected by search engine query volumes. Unexpected seasonal variations of these queries suggest a previously unknown variability of the respective disease prevalence. Furthermore, using the example of allergic rhinitis, a close correlation of search engine query data with actual pollen count can be demonstrated. DISCUSSION In many cases, search engine query data are appropriate to estimate seasonal variability in prevalence of common dermatoses. This finding may be useful for real-time analysis and formation of hypotheses concerning pathogenetic or symptom aggravating mechanisms and may thus contribute to improvement of diagnostics and prevention of skin diseases.
Collapse
Affiliation(s)
- M J Köhler
- Klinik für Hautkrankheiten, Universitätsklinikum Jena, Erfurter Str. 35, 07743, Jena, Deutschland,
| | | | | |
Collapse
|
33
|
Nolte N, Kurzawa N, Eils R, Herrmann C. MapMyFlu: visualizing spatio-temporal relationships between related influenza sequences. Nucleic Acids Res 2015; 43:W547-51. [PMID: 25940623 PMCID: PMC4489300 DOI: 10.1093/nar/gkv417] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2015] [Accepted: 04/18/2015] [Indexed: 11/13/2022] Open
Abstract
Understanding the molecular dynamics of viral spreading is crucial for anticipating the epidemiological implications of disease outbreaks. In the case of influenza, reassortments or point mutations affect the adaption to new hosts or resistance to anti-viral drugs and can determine whether a new strain will result in a pandemic infection or a less severe progression. To this end, tools integrating molecular information with epidemiological parameters are important to understand how molecular characteristics reflect in the infection dynamics. We present a new web tool, MapMyFlu, which allows to spatially and temporally display influenza viruses related to a query sequence on a Google Map based on BLAST results against the NCBI Influenza Database. Temporal and geographical trends appear clearly and may help in reconstructing the evolutionary history of a particular sequence. The tool is accessible through a web server, hence without the need for local installation. The website has an intuitive design and provides an easy-to-use service, and is available at http://mapmyflu.ipmb.uni-heidelberg.de
Collapse
Affiliation(s)
- Nicholas Nolte
- Institute of Pharmacy and Molecular Biotechnology, and Bioquant Center, University of Heidelberg, Im Neuenheimer Feld 267, Heidelberg 69120, Germany Division of Theoretical Bioinformatics, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 580, Heidelberg 69120, Germany
| | - Nils Kurzawa
- Institute of Pharmacy and Molecular Biotechnology, and Bioquant Center, University of Heidelberg, Im Neuenheimer Feld 267, Heidelberg 69120, Germany Division of Theoretical Bioinformatics, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 580, Heidelberg 69120, Germany
| | - Roland Eils
- Institute of Pharmacy and Molecular Biotechnology, and Bioquant Center, University of Heidelberg, Im Neuenheimer Feld 267, Heidelberg 69120, Germany Division of Theoretical Bioinformatics, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 580, Heidelberg 69120, Germany
| | - Carl Herrmann
- Institute of Pharmacy and Molecular Biotechnology, and Bioquant Center, University of Heidelberg, Im Neuenheimer Feld 267, Heidelberg 69120, Germany Division of Theoretical Bioinformatics, German Cancer Research Center (DKFZ), Im Neuenheimer Feld 580, Heidelberg 69120, Germany
| |
Collapse
|
34
|
Stevens KB, Pfeiffer DU. Sources of spatial animal and human health data: Casting the net wide to deal more effectively with increasingly complex disease problems. Spat Spatiotemporal Epidemiol 2015; 13:15-29. [PMID: 26046634 PMCID: PMC7102771 DOI: 10.1016/j.sste.2015.04.003] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/02/2015] [Accepted: 04/28/2015] [Indexed: 12/29/2022]
Abstract
During the last 30years it has become commonplace for epidemiological studies to collect locational attributes of disease data. Although this advancement was driven largely by the introduction of handheld global positioning systems (GPS), and more recently, smartphones and tablets with built-in GPS, the collection of georeferenced disease data has moved beyond the use of handheld GPS devices and there now exist numerous sources of crowdsourced georeferenced disease data such as that available from georeferencing of Google search queries or Twitter messages. In addition, cartography has moved beyond the realm of professionals to crowdsourced mapping projects that play a crucial role in disease control and surveillance of outbreaks such as the 2014 West Africa Ebola epidemic. This paper provides a comprehensive review of a range of innovative sources of spatial animal and human health data including data warehouses, mHealth, Google Earth, volunteered geographic information and mining of internet-based big data sources such as Google and Twitter. We discuss the advantages, limitations and applications of each, and highlight studies where they have been used effectively.
Collapse
Affiliation(s)
- Kim B Stevens
- Veterinary Epidemiology, Economics and Public Health Group, Dept. of Production & Population Health, Royal Veterinary College, London, United Kingdom.
| | - Dirk U Pfeiffer
- Veterinary Epidemiology, Economics and Public Health Group, Dept. of Production & Population Health, Royal Veterinary College, London, United Kingdom.
| |
Collapse
|
35
|
Nguyen T, Tran T, Luo W, Gupta S, Rana S, Phung D, Nichols M, Millar L, Venkatesh S, Allender S. Web search activity data accurately predict population chronic disease risk in the USA. J Epidemiol Community Health 2015; 69:693-9. [PMID: 25805603 DOI: 10.1136/jech-2014-204523] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2014] [Accepted: 01/26/2015] [Indexed: 12/17/2022]
Abstract
BACKGROUND The WHO framework for non-communicable disease (NCD) describes risks and outcomes comprising the majority of the global burden of disease. These factors are complex and interact at biological, behavioural, environmental and policy levels presenting challenges for population monitoring and intervention evaluation. This paper explores the utility of machine learning methods applied to population-level web search activity behaviour as a proxy for chronic disease risk factors. METHODS Web activity output for each element of the WHO's Causes of NCD framework was used as a basis for identifying relevant web search activity from 2004 to 2013 for the USA. Multiple linear regression models with regularisation were used to generate predictive algorithms, mapping web search activity to Centers for Disease Control and Prevention (CDC) measured risk factor/disease prevalence. Predictions for subsequent target years not included in the model derivation were tested against CDC data from population surveys using Pearson correlation and Spearman's r. RESULTS For 2011 and 2012, predicted prevalence was very strongly correlated with measured risk data ranging from fruits and vegetables consumed (r=0.81; 95% CI 0.68 to 0.89) to alcohol consumption (r=0.96; 95% CI 0.93 to 0.98). Mean difference between predicted and measured differences by State ranged from 0.03 to 2.16. Spearman's r for state-wise predicted versus measured prevalence varied from 0.82 to 0.93. CONCLUSIONS The high predictive validity of web search activity for NCD risk has potential to provide real-time information on population risk during policy implementation and other population-level NCD prevention efforts.
Collapse
Affiliation(s)
- Thin Nguyen
- Centre for Pattern Recognition and Data Analytics, School of Information Technology, Deakin University, Geelong, Victoria, Australia
| | - Truyen Tran
- Centre for Pattern Recognition and Data Analytics, School of Information Technology, Deakin University, Geelong, Victoria, Australia
| | - Wei Luo
- Centre for Pattern Recognition and Data Analytics, School of Information Technology, Deakin University, Geelong, Victoria, Australia
| | - Sunil Gupta
- Centre for Pattern Recognition and Data Analytics, School of Information Technology, Deakin University, Geelong, Victoria, Australia
| | - Santu Rana
- Centre for Pattern Recognition and Data Analytics, School of Information Technology, Deakin University, Geelong, Victoria, Australia
| | - Dinh Phung
- Centre for Pattern Recognition and Data Analytics, School of Information Technology, Deakin University, Geelong, Victoria, Australia
| | - Melanie Nichols
- World Health Organization Collaborating Centre for Obesity Prevention, Deakin University, Geelong, Victoria, Australia
| | - Lynne Millar
- World Health Organization Collaborating Centre for Obesity Prevention, Deakin University, Geelong, Victoria, Australia
| | - Svetha Venkatesh
- Centre for Pattern Recognition and Data Analytics, School of Information Technology, Deakin University, Geelong, Victoria, Australia
| | - Steve Allender
- World Health Organization Collaborating Centre for Obesity Prevention, Deakin University, Geelong, Victoria, Australia
| |
Collapse
|
36
|
Ziemann A, Rosenkötter N, Riesgo LGC, Fischer M, Krämer A, Lippert FK, Vergeiner G, Brand H, Krafft T. Meeting the International Health Regulations (2005) surveillance core capacity requirements at the subnational level in Europe: the added value of syndromic surveillance. BMC Public Health 2015; 15:107. [PMID: 25879869 PMCID: PMC4324797 DOI: 10.1186/s12889-015-1421-2] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2014] [Accepted: 01/15/2015] [Indexed: 11/10/2022] Open
Abstract
Background The revised World Health Organization’s International Health Regulations (2005) request a timely and all-hazard approach towards surveillance, especially at the subnational level. We discuss three questions of syndromic surveillance application in the European context for assessing public health emergencies of international concern: (i) can syndromic surveillance support countries, especially the subnational level, to meet the International Health Regulations (2005) core surveillance capacity requirements, (ii) are European syndromic surveillance systems comparable to enable cross-border surveillance, and (iii) at which administrative level should syndromic surveillance best be applied? Discussion Despite the ongoing criticism on the usefulness of syndromic surveillance which is related to its clinically nonspecific output, we demonstrate that it was a suitable supplement for timely assessment of the impact of three different public health emergencies affecting Europe. Subnational syndromic surveillance analysis in some cases proved to be of advantage for detecting an event earlier compared to national level analysis. However, in many cases, syndromic surveillance did not detect local events with only a small number of cases. The European Commission envisions comparability of surveillance output to enable cross-border surveillance. Evaluated against European infectious disease case definitions, syndromic surveillance can contribute to identify cases that might fulfil the clinical case definition but the approach is too unspecific to comply to complete clinical definitions. Syndromic surveillance results still seem feasible for comparable cross-border surveillance as similarly defined syndromes are analysed. We suggest a new model of implementing syndromic surveillance at the subnational level. In this model, syndromic surveillance systems are fine-tuned to their local context and integrated into the existing subnational surveillance and reporting structure. By enhancing population coverage, events covering several jurisdictions can be identified at higher levels. However, the setup of decentralised and locally adjusted syndromic surveillance systems is more complex compared to the setup of one national or local system. Summary We conclude that syndromic surveillance if implemented with large population coverage at the subnational level can help detect and assess the local and regional effect of different types of public health emergencies in a timely manner as required by the International Health Regulations (2005).
Collapse
Affiliation(s)
- Alexandra Ziemann
- Department of International Health, School of Public Health and Primary Care (CAPHRI), Faculty of Health, Medicine and Life Sciences, Maastricht University, P.O. Box 616, 6200, MD, Maastricht, The Netherlands.
| | - Nicole Rosenkötter
- Department of International Health, School of Public Health and Primary Care (CAPHRI), Faculty of Health, Medicine and Life Sciences, Maastricht University, P.O. Box 616, 6200, MD, Maastricht, The Netherlands.
| | - Luis Garcia-Castrillo Riesgo
- Department of Medical Sciences and Surgery, Faculty of Medicine, University of Cantabria, Avenida de los Castros s/n, 39005, Santander, Spain.
| | - Matthias Fischer
- Department of Anaesthesia and Intensive Care, Klinik am Eichert, Postfach 660, 73006, Göppingen, Germany.
| | - Alexander Krämer
- Department of Public Health Medicine, School of Public Health, University of Bielefeld, P.O. Box 100131, 33501, Bielefeld, Germany.
| | - Freddy K Lippert
- Emergency Medical Services, Head Office, Capital Region of Denmark, Telegrafvej 5, 2750, Ballerup, Denmark. .,Department of Clinical Medicine, Faculty of Health and Medical Sciences, University of Copenhagen, Blegdamsvej 9, 2100, Copenhagen, Denmark.
| | - Gernot Vergeiner
- Dispatch Centre Tyrol (Leitstelle Tirol Gesellschaft mbH), Hunoldstrasse 17a, 6020, Innsbruck, Austria.
| | - Helmut Brand
- Department of International Health, School of Public Health and Primary Care (CAPHRI), Faculty of Health, Medicine and Life Sciences, Maastricht University, P.O. Box 616, 6200, MD, Maastricht, The Netherlands.
| | - Thomas Krafft
- Department of International Health, School of Public Health and Primary Care (CAPHRI), Faculty of Health, Medicine and Life Sciences, Maastricht University, P.O. Box 616, 6200, MD, Maastricht, The Netherlands. .,Institute of Environment Education and Research, Bharati Vidyapeeth University, Katraj, Dhankawadi, Satara Road, Pune, 411043, India. .,Institute for Geographic Sciences and Natural Resources Research, Chinese Academy of Sciences, A11 Datun Road, Beijing, 100101, China.
| |
Collapse
|
37
|
Kang MG, Song WJ, Choi S, Kim H, Ha H, Kim SH, Cho SH, Min KU, Yoon S, Chang YS. Google unveils a glimpse of allergic rhinitis in the real world. Allergy 2015; 70:124-8. [PMID: 25280183 DOI: 10.1111/all.12528] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/28/2014] [Indexed: 12/01/2022]
Abstract
Google Trends (GT) is a Web-based surveillance tool used to explore the searching trends of specific queries on Google. Recent studies have suggested the utility of GT in predicting outbreaks of influenza and other diseases. However, this utility has not been thoroughly evaluated for allergic diseases. Therefore, we investigated the utility of GT for predicting the epidemiology of allergic rhinitis. In the USA, GT for allergic rhinitis showed repetitive seasonality that peaked in late April and early May and then rapidly decreased, and a second small peak occurred in September. These trends are highly correlated with the searching trends for other queries such as 'pollen count', antihistamines such as loratadine and cetirizine (all r > 0.88 and all P < 0.001), and even the total pollen count collected from 21 pollen counters across the USA (r = 0.928, P < 0.001). Google Trends for allergic rhinitis was similar to the monthly changes in rhinitis symptoms according to the US National Health and Nutrition Examination Survey III, sales for Claritin(®) and all over-the-counter antihistamines, and the number of monthly page views of 'claritin.com'. In conclusion, GT closely reflects the real-world epidemiology of allergic rhinitis in the USA and could potentially be used as a monitoring tool for allergic rhinitis.
Collapse
Affiliation(s)
- M.-G. Kang
- Department of Internal Medicine; Seoul National University College of Medicine; Seoul Korea
- Institute of Allergy and Clinical Immunology; Seoul National University Medical Research Center; Seoul Korea
- Division of Allergy and Clinical Immunology; Department of Internal Medicine; Seoul National University Bundang Hospital; Seongnam Gyeonggi-do Korea
| | - W.-J. Song
- Department of Internal Medicine; Seoul National University College of Medicine; Seoul Korea
- Institute of Allergy and Clinical Immunology; Seoul National University Medical Research Center; Seoul Korea
| | - S. Choi
- Department of Electrical and Computer Engineering; Seoul National University; Seoul Korea
- Department of IT Convergence; Korea University; Seoul Korea
| | - H. Kim
- Department of Electrical and Computer Engineering; Seoul National University; Seoul Korea
| | - H. Ha
- Department of Electrical and Computer Engineering; Seoul National University; Seoul Korea
| | - S.-H. Kim
- Department of Internal Medicine; Seoul National University College of Medicine; Seoul Korea
- Institute of Allergy and Clinical Immunology; Seoul National University Medical Research Center; Seoul Korea
- Division of Allergy and Clinical Immunology; Department of Internal Medicine; Seoul National University Bundang Hospital; Seongnam Gyeonggi-do Korea
| | - S.-H. Cho
- Department of Internal Medicine; Seoul National University College of Medicine; Seoul Korea
- Institute of Allergy and Clinical Immunology; Seoul National University Medical Research Center; Seoul Korea
| | - K.-U. Min
- Department of Internal Medicine; Seoul National University College of Medicine; Seoul Korea
- Institute of Allergy and Clinical Immunology; Seoul National University Medical Research Center; Seoul Korea
| | - S. Yoon
- Department of Electrical and Computer Engineering; Seoul National University; Seoul Korea
| | - Y.-S. Chang
- Department of Internal Medicine; Seoul National University College of Medicine; Seoul Korea
- Institute of Allergy and Clinical Immunology; Seoul National University Medical Research Center; Seoul Korea
- Division of Allergy and Clinical Immunology; Department of Internal Medicine; Seoul National University Bundang Hospital; Seongnam Gyeonggi-do Korea
| |
Collapse
|
38
|
Milinovich GJ, Avril SMR, Clements ACA, Brownstein JS, Tong S, Hu W. Using internet search queries for infectious disease surveillance: screening diseases for suitability. BMC Infect Dis 2014; 14:690. [PMID: 25551277 PMCID: PMC4300155 DOI: 10.1186/s12879-014-0690-1] [Citation(s) in RCA: 45] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2014] [Accepted: 12/09/2014] [Indexed: 11/29/2022] Open
Abstract
BACKGROUND Internet-based surveillance systems provide a novel approach to monitoring infectious diseases. Surveillance systems built on internet data are economically, logistically and epidemiologically appealing and have shown significant promise. The potential for these systems has increased with increased internet availability and shifts in health-related information seeking behaviour. This approach to monitoring infectious diseases has, however, only been applied to single or small groups of select diseases. This study aims to systematically investigate the potential for developing surveillance and early warning systems using internet search data, for a wide range of infectious diseases. METHODS Official notifications for 64 infectious diseases in Australia were downloaded and correlated with frequencies for 164 internet search terms for the period 2009-13 using Spearman's rank correlations. Time series cross correlations were performed to assess the potential for search terms to be used in construction of early warning systems. RESULTS Notifications for 17 infectious diseases (26.6%) were found to be significantly correlated with a selected search term. The use of internet metrics as a means of surveillance has not previously been described for 12 (70.6%) of these diseases. The majority of diseases identified were vaccine-preventable, vector-borne or sexually transmissible; cross correlations, however, indicated that vector-borne and vaccine preventable diseases are best suited for development of early warning systems. CONCLUSIONS The findings of this study suggest that internet-based surveillance systems have broader applicability to monitoring infectious diseases than has previously been recognised. Furthermore, internet-based surveillance systems have a potential role in forecasting emerging infectious disease events, especially for vaccine-preventable and vector-borne diseases.
Collapse
Affiliation(s)
- Gabriel J Milinovich
- School of Public Health and Social Work, Queensland University of Technology, Brisbane, Australia.
- Infectious Disease Epidemiology Unit, School of Population Health, The University of Queensland, Brisbane, Australia.
| | | | - Archie C A Clements
- Research School of Population Health, ANU College of Medicine, Biology and Environment, The Australian National University, Canberra, Australia.
| | - John S Brownstein
- Department of Pediatrics, Harvard Medical School and Children's Hospital Informatics Program, Boston Children's Hospital, Boston, USA.
| | - Shilu Tong
- School of Public Health and Social Work, Queensland University of Technology, Brisbane, Australia.
| | - Wenbiao Hu
- School of Public Health and Social Work, Queensland University of Technology, Brisbane, Australia.
| |
Collapse
|
39
|
Seo DW, Jo MW, Sohn CH, Shin SY, Lee J, Yu M, Kim WY, Lim KS, Lee SI. Cumulative query method for influenza surveillance using search engine data. J Med Internet Res 2014; 16:e289. [PMID: 25517353 PMCID: PMC4275481 DOI: 10.2196/jmir.3680] [Citation(s) in RCA: 28] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2014] [Revised: 08/25/2014] [Accepted: 11/21/2014] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Internet search queries have become an important data source in syndromic surveillance system. However, there is currently no syndromic surveillance system using Internet search query data in South Korea. OBJECTIVES The objective of this study was to examine correlations between our cumulative query method and national influenza surveillance data. METHODS Our study was based on the local search engine, Daum (approximately 25% market share), and influenza-like illness (ILI) data from the Korea Centers for Disease Control and Prevention. A quota sampling survey was conducted with 200 participants to obtain popular queries. We divided the study period into two sets: Set 1 (the 2009/10 epidemiological year for development set 1 and 2010/11 for validation set 1) and Set 2 (2010/11 for development Set 2 and 2011/12 for validation Set 2). Pearson's correlation coefficients were calculated between the Daum data and the ILI data for the development set. We selected the combined queries for which the correlation coefficients were .7 or higher and listed them in descending order. Then, we created a cumulative query method n representing the number of cumulative combined queries in descending order of the correlation coefficient. RESULTS In validation set 1, 13 cumulative query methods were applied, and 8 had higher correlation coefficients (min=.916, max=.943) than that of the highest single combined query. Further, 11 of 13 cumulative query methods had an r value of ≥.7, but 4 of 13 combined queries had an r value of ≥.7. In validation set 2, 8 of 15 cumulative query methods showed higher correlation coefficients (min=.975, max=.987) than that of the highest single combined query. All 15 cumulative query methods had an r value of ≥.7, but 6 of 15 combined queries had an r value of ≥.7. CONCLUSIONS Cumulative query method showed relatively higher correlation with national influenza surveillance data than combined queries in the development and validation set.
Collapse
Affiliation(s)
- Dong-Woo Seo
- Asan Medical Center, Department of Emergency Medicine, University of Ulsan, College of Medicine, Seoul, Republic Of Korea
| | | | | | | | | | | | | | | | | |
Collapse
|
40
|
Fazeli Dehkordy S, Carlos RC, Hall KS, Dalton VK. Novel data sources for women's health research: mapping breast screening online information seeking through Google trends. Acad Radiol 2014; 21:1172-6. [PMID: 24998689 DOI: 10.1016/j.acra.2014.05.005] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2014] [Revised: 05/15/2014] [Accepted: 05/15/2014] [Indexed: 10/25/2022]
Abstract
RATIONALE AND OBJECTIVES Millions of people use online search engines everyday to find health-related information and voluntarily share their personal health status and behaviors in various Web sites. Thus, data from tracking of online information seeker's behavior offer potential opportunities for use in public health surveillance and research. Google Trends is a feature of Google which allows Internet users to graph the frequency of searches for a single term or phrase over time or by geographic region. We used Google Trends to describe patterns of information-seeking behavior in the subject of dense breasts and to examine their correlation with the passage or introduction of dense breast notification legislation. MATERIALS AND METHODS To capture the temporal variations of information seeking about dense breasts, the Web search query "dense breast" was entered in the Google Trends tool. We then mapped the dates of legislative actions regarding dense breasts that received widespread coverage in the lay media to information-seeking trends about dense breasts over time. RESULTS Newsworthy events and legislative actions appear to correlate well with peaks in search volume of "dense breast". Geographic regions with the highest search volumes have passed, denied, or are currently considering the dense breast legislation. CONCLUSIONS Our study demonstrated that any legislative action and respective news coverage correlate with increase in information seeking for "dense breast" on Google, suggesting that Google Trends has the potential to serve as a data source for policy-relevant research.
Collapse
|
41
|
Al-Tawfiq JA, Zumla A, Gautret P, Gray GC, Hui DS, Al-Rabeeah AA, Memish ZA. Surveillance for emerging respiratory viruses. THE LANCET. INFECTIOUS DISEASES 2014; 14:992-1000. [PMID: 25189347 PMCID: PMC7106459 DOI: 10.1016/s1473-3099(14)70840-0] [Citation(s) in RCA: 85] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Download PDF] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Several new viral respiratory tract infectious diseases with epidemic potential that threaten global health security have emerged in the past 15 years. In 2003, WHO issued a worldwide alert for an unknown emerging illness, later named severe acute respiratory syndrome (SARS). The disease caused by a novel coronavirus (SARS-CoV) rapidly spread worldwide, causing more than 8000 cases and 800 deaths in more than 30 countries with a substantial economic impact. Since then, we have witnessed the emergence of several other viral respiratory pathogens including influenza viruses (avian influenza H5N1, H7N9, and H10N8; variant influenza A H3N2 virus), human adenovirus-14, and Middle East respiratory syndrome coronavirus (MERS-CoV). In response, various surveillance systems have been developed to monitor the emergence of respiratory-tract infections. These include systems based on identification of syndromes, web-based systems, systems that gather health data from health facilities (such as emergency departments and family doctors), and systems that rely on self-reporting by patients. More effective national, regional, and international surveillance systems are required to enable rapid identification of emerging respiratory epidemics, diseases with epidemic potential, their specific microbial cause, origin, mode of acquisition, and transmission dynamics.
Collapse
Affiliation(s)
- Jaffar A Al-Tawfiq
- Johns Hopkins Aramco Healthcare, Dhahran, Saudi Arabia; Indiana University School of Medicine, Indianapolis, Indiana, USA
| | - Alimuddin Zumla
- Division of Infection and Immunity, University College London, London, UK; NIHR Biomedical Research Centre, University College London Hospitals, London, UK; Global Center for Mass Gatherings Medicine, Ministry of Health, Riyadh, Saudi Arabia
| | - Philippe Gautret
- Assistance Publique Hôpitaux de Marseille, CHU Nord, Pôle Infectieux, Institut Hospitalo-Universitaire Méditerranée Infection & Aix Marseille Université, Unité de Recherche en Maladies Infectieuses et Tropicales Emergentes (URMITE), Marseille, France
| | - Gregory C Gray
- Department of Environmental and Global Health, College of Public Health and Health Professions, University of Florida
| | - David S Hui
- Division of Respiratory Medicine and Stanley Ho Center for emerging Infectious Diseases, The Chinese University of Hong Kong, Prince of Wales Hospital, New Territories, Hong Kong
| | - Abdullah A Al-Rabeeah
- Global Center for Mass Gatherings Medicine, Ministry of Health, Riyadh, Saudi Arabia
| | - Ziad A Memish
- Global Center for Mass Gatherings Medicine, Ministry of Health, Riyadh, Saudi Arabia; Al-Faisal University, Riyadh, Saudi Arabia.
| |
Collapse
|
42
|
Zhang Y, Arab A, Cowling BJ, Stoto MA. Characterizing Influenza surveillance systems performance: application of a Bayesian hierarchical statistical model to Hong Kong surveillance data. BMC Public Health 2014; 14:850. [PMID: 25127906 PMCID: PMC4246552 DOI: 10.1186/1471-2458-14-850] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2014] [Accepted: 08/06/2014] [Indexed: 11/21/2022] Open
Abstract
BACKGROUND Infectious disease surveillance is a process the product of which reflects both actual disease trends and public awareness of the disease. Decisions made by patients, health care providers, and public health professionals about seeking and providing health care and about reporting cases to health authorities are all influenced by the information environment, which changes constantly. Biases are therefore imbedded in surveillance systems; these biases need to be characterized to provide better situational awareness for decision-making purposes. Our goal is to develop a statistical framework to characterize influenza surveillance systems, particularly their correlation with the information environment. METHODS We identified Hong Kong influenza surveillance data systems covering healthcare providers, laboratories, daycare centers and residential care homes for the elderly. A Bayesian hierarchical statistical model was developed to examine the statistical relationships between the influenza surveillance data and the information environment represented by alerts from HealthMap and web queries from Google. Different models were fitted for non-pandemic and pandemic periods and model goodness-of-fit was assessed using common model selection procedures. RESULTS Some surveillance systems - especially ad hoc systems developed in response to the pandemic flu outbreak - are more correlated with the information environment than others. General practitioner (percentage of influenza-like-illness related patient visits among all patient visits) and laboratory (percentage of specimen tested positive) seem to proportionally reflect the actual disease trends and are less representative of the information environment. Surveillance systems using influenza-specific code for reporting tend to reflect biases of both healthcare seekers and providers. CONCLUSIONS This study shows certain influenza surveillance systems are less correlated with the information environment than others, and therefore, might represent more reliable indicators of disease activity in future outbreaks. Although the patterns identified in this study might change in future outbreaks, the potential susceptibility of surveillance data is likely to persist in the future, and should be considered when interpreting surveillance data.
Collapse
Affiliation(s)
- Ying Zhang
- />Department of Health Systems Administration, School of Nursing and Health Studies, Georgetown University, Washington, DC USA
| | - Ali Arab
- />Department of Mathematics and Statistics, Georgetown University, Washington, DC USA
| | - Benjamin J Cowling
- />School of Public Health, Li KaShing Faculty of Medicine, The University of Hong Kong, Hong Kong, Special Administrative Region, China
| | - Michael A Stoto
- />Department of Health Systems Administration, School of Nursing and Health Studies, Georgetown University, Washington, DC USA
| |
Collapse
|
43
|
Gerbier-Colomban S, Potinet-Pagliaroli V, Metzger MH. Can epidemic detection systems at the hospital level complement regional surveillance networks: case study with the influenza epidemic? BMC Infect Dis 2014; 14:381. [PMID: 25011679 PMCID: PMC4227032 DOI: 10.1186/1471-2334-14-381] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2013] [Accepted: 06/30/2014] [Indexed: 11/10/2022] Open
Abstract
Background Early knowledge of influenza outbreaks in the community allows local hospital healthcare workers to recognise the clinical signs of influenza in hospitalised patients and to apply effective precautions. The objective was to assess intra-hospital surveillance systems to detect earlier than regional surveillance systems influenza outbreaks in the community. Methods Time series obtained from computerized medical data from patients who visited a French hospital emergency department (ED) between June 1st, 2007 and March 31st, 2011 for influenza, or were hospitalised for influenza or a respiratory syndrome after an ED visit, were compared to different regional series. Algorithms using CUSUM method were constructed to determine the epidemic detection threshold with the local data series. Sensitivity, specificity and mean timeliness were calculated to assess their performance to detect community outbreaks of influenza. A sensitivity analysis was conducted, excluding the year 2009, due to the particular epidemiological situation related to pandemic influenza this year. Results The local series closely followed the seasonal trends reported by regional surveillance. The algorithms achieved a sensitivity of detection equal to 100% with series of patients hospitalised with respiratory syndrome (specificity ranging from 31.9 and 92.9% and mean timeliness from −58.3 to 20.3 days) and series of patients who consulted the ED for flu (specificity ranging from 84.3 to 93.2% and mean timeliness from −32.3 to 9.8 days). The algorithm with the best balance between specificity (87.7%) and mean timeliness (0.5 day) was obtained with series built by analysis of the ICD-10 codes assigned by physicians after ED consultation. Excluding the year 2009, the same series keeps the best performance with specificity equal to 95.7% and mean timeliness equal to −1.7 day. Conclusions The implementation of an automatic surveillance system to detect patients with influenza or respiratory syndrome from computerized ED records could allow outbreak alerts at the intra-hospital level before the publication of regional data and could accelerate the implementation of preventive transmission-based precautions in hospital settings.
Collapse
Affiliation(s)
- Solweig Gerbier-Colomban
- Hospices Civils de Lyon, Hôpital de la Croix-Rousse, Unité d'hygiène et d'épidémiologie, F-69317 Lyon, France.
| | | | | |
Collapse
|
44
|
Milinovich GJ, Williams GM, Clements ACA, Hu W. Internet-based surveillance systems for monitoring emerging infectious diseases. THE LANCET. INFECTIOUS DISEASES 2014; 14:160-8. [PMID: 24290841 PMCID: PMC7185571 DOI: 10.1016/s1473-3099(13)70244-5] [Citation(s) in RCA: 173] [Impact Index Per Article: 15.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Emerging infectious diseases present a complex challenge to public health officials and governments; these challenges have been compounded by rapidly shifting patterns of human behaviour and globalisation. The increase in emerging infectious diseases has led to calls for new technologies and approaches for detection, tracking, reporting, and response. Internet-based surveillance systems offer a novel and developing means of monitoring conditions of public health concern, including emerging infectious diseases. We review studies that have exploited internet use and search trends to monitor two such diseases: influenza and dengue. Internet-based surveillance systems have good congruence with traditional surveillance approaches. Additionally, internet-based approaches are logistically and economically appealing. However, they do not have the capacity to replace traditional surveillance systems; they should not be viewed as an alternative, but rather an extension. Future research should focus on using data generated through internet-based surveillance and response systems to bolster the capacity of traditional surveillance systems for emerging infectious diseases.
Collapse
Affiliation(s)
- Gabriel J Milinovich
- Infectious Disease Epidemiology Unit, School of Population Health, The University of Queensland, Herston, QLD, Australia.
| | - Gail M Williams
- Infectious Disease Epidemiology Unit, School of Population Health, The University of Queensland, Herston, QLD, Australia
| | - Archie C A Clements
- Infectious Disease Epidemiology Unit, School of Population Health, The University of Queensland, Herston, QLD, Australia
| | - Wenbiao Hu
- Infectious Disease Epidemiology Unit, School of Population Health, The University of Queensland, Herston, QLD, Australia; School of Public Health and Social Work, Queensland University of Technology, Kelvin Grove, QLD, Australia
| |
Collapse
|
45
|
Scherm H, Thomas CS, Garrett KA, Olsen JM. Meta-analysis and other approaches for synthesizing structured and unstructured data in plant pathology. ANNUAL REVIEW OF PHYTOPATHOLOGY 2014; 52:453-76. [PMID: 25001455 DOI: 10.1146/annurev-phyto-102313-050214] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/12/2023]
Abstract
The term data deluge is used widely to describe the rapidly accelerating growth of information in the technical literature, in scientific databases, and in informal sources such as the Internet and social media. The massive volume and increased complexity of information challenge traditional methods of data analysis but at the same time provide unprecedented opportunities to test hypotheses or uncover new relationships via mining of existing databases and literature. In this review, we discuss analytical approaches that are beginning to be applied to help synthesize the vast amount of information generated by the data deluge and thus accelerate the pace of discovery in plant pathology. We begin with a review of meta-analysis as an established approach for summarizing standardized (structured) data across the literature. We then turn to examples of synthesizing more complex, unstructured data sets through a range of data-mining approaches, including the incorporation of 'omics data in epidemiological analyses. We conclude with a discussion of methodologies for leveraging information contained in novel, open-source data sets through web crawling, text mining, and social media analytics, primarily in the context of digital disease surveillance. Rapidly evolving computational resources provide platforms for integrating large and complex data sets, motivating research that will draw on new types and scales of information to address big questions.
Collapse
Affiliation(s)
- H Scherm
- Department of Plant Pathology, University of Georgia, Athens, Georgia 30602;
| | | | | | | |
Collapse
|
46
|
Cho S, Sohn CH, Jo MW, Shin SY, Lee JH, Ryoo SM, Kim WY, Seo DW. Correlation between national influenza surveillance data and google trends in South Korea. PLoS One 2013; 8:e81422. [PMID: 24339927 PMCID: PMC3855287 DOI: 10.1371/journal.pone.0081422] [Citation(s) in RCA: 69] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2013] [Accepted: 10/11/2013] [Indexed: 11/28/2022] Open
Abstract
BACKGROUND In South Korea, there is currently no syndromic surveillance system using internet search data, including Google Flu Trends. The purpose of this study was to investigate the correlation between national influenza surveillance data and Google Trends in South Korea. METHODS Our study was based on a publicly available search engine database, Google Trends, using 12 influenza-related queries, from September 9, 2007 to September 8, 2012. National surveillance data were obtained from the Korea Centers for Disease Control and Prevention (KCDC) influenza-like illness (ILI) and virologic surveillance system. Pearson's correlation coefficients were calculated to compare the national surveillance and the Google Trends data for the overall period and for 5 influenza seasons. RESULTS The correlation coefficient between the KCDC ILI and virologic surveillance data was 0.72 (p<0.05). The highest correlation was between the Google Trends query of H1N1 and the ILI data, with a correlation coefficient of 0.53 (p<0.05), for the overall study period. When compared with the KCDC virologic data, the Google Trends query of bird flu had the highest correlation with a correlation coefficient of 0.93 (p<0.05) in the 2010-11 season. The following queries showed a statistically significant correlation coefficient compared with ILI data for three consecutive seasons: Tamiflu (r = 0.59, 0.86, 0.90, p<0.05), new flu (r = 0.64, 0.43, 0.70, p<0.05) and flu (r = 0.68, 0.43, 0.77, p<0.05). CONCLUSIONS In our study, we found that the Google Trends for certain queries using the survey on influenza correlated with national surveillance data in South Korea. The results of this study showed that Google Trends in the Korean language can be used as complementary data for influenza surveillance but was insufficient for the use of predictive models, such as Google Flu Trends.
Collapse
Affiliation(s)
- Sungjin Cho
- Department of Emergency Medicine, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Chang Hwan Sohn
- Department of Emergency Medicine, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Min Woo Jo
- Department of Preventive Medicine, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Soo-Yong Shin
- Department of Biomedical Informatics, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Jae Ho Lee
- Department of Emergency Medicine, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
- Department of Biomedical Informatics, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Seoung Mok Ryoo
- Department of Emergency Medicine, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Won Young Kim
- Department of Emergency Medicine, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
| | - Dong-Woo Seo
- Department of Emergency Medicine, University of Ulsan, College of Medicine, Asan Medical Center, Seoul, South Korea
| |
Collapse
|
47
|
Rossignol L, Pelat C, Lambert B, Flahault A, Chartier-Kastler E, Hanslik T. A method to assess seasonality of urinary tract infections based on medication sales and google trends. PLoS One 2013; 8:e76020. [PMID: 24204587 PMCID: PMC3808386 DOI: 10.1371/journal.pone.0076020] [Citation(s) in RCA: 46] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2013] [Accepted: 08/16/2013] [Indexed: 11/19/2022] Open
Abstract
BACKGROUND Despite the fact that urinary tract infection (UTI) is a very frequent disease, little is known about its seasonality in the community. METHODS AND FINDINGS To estimate seasonality of UTI using multiple time series constructed with available proxies of UTI. Eight time series based on two databases were used: sales of urinary antibacterial medications reported by a panel of pharmacy stores in France between 2000 and 2012, and search trends on the Google search engine for UTI-related terms between 2004 and 2012 in France, Germany, Italy, the USA, China, Australia and Brazil. Differences between summers and winters were statistically assessed with the Mann-Whitney test. We evaluated seasonality by applying the Harmonics Product Spectrum on Fast Fourier Transform. Seven time series out of eight displayed a significant increase in medication sales or web searches in the summer compared to the winter, ranging from 8% to 20%. The eight time series displayed a periodicity of one year. Annual increases were seen in the summer for UTI drug sales in France and Google searches in France, the USA, Germany, Italy, and China. Increases occurred in the austral summer for Google searches in Brazil and Australia. CONCLUSIONS An annual seasonality of UTIs was evidenced in seven different countries, with peaks during the summer.
Collapse
Affiliation(s)
- Louise Rossignol
- Département de médecine générale, UPMC Univ Paris 06, Paris, France
- UMRS 707, UPMC Univ Paris 06, Paris, France
- U707, INSERM, Paris, France
| | - Camille Pelat
- U738, INSERM, Paris, France
- UMRS 738, Université Paris Diderot, Paris, France
| | | | - Antoine Flahault
- U707, INSERM, Paris, France
- Descartes School of Medicine, Sorbonne Paris Cité, Paris, France
| | - Emmanuel Chartier-Kastler
- Urologist hopital universitaire Pitié-Salpêtrière AP-HP, faculté de médecine Pierre et Marie Curie Paris VI, Paris, France
| | - Thomas Hanslik
- U707, INSERM, Paris, France
- Université Versailles-Saint-Quentin-en-Yvelines, Versailles, France
| |
Collapse
|
48
|
Olson DR, Konty KJ, Paladini M, Viboud C, Simonsen L. Reassessing Google Flu Trends data for detection of seasonal and pandemic influenza: a comparative epidemiological study at three geographic scales. PLoS Comput Biol 2013; 9:e1003256. [PMID: 24146603 PMCID: PMC3798275 DOI: 10.1371/journal.pcbi.1003256] [Citation(s) in RCA: 243] [Impact Index Per Article: 20.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2013] [Accepted: 08/20/2013] [Indexed: 11/18/2022] Open
Abstract
The goal of influenza-like illness (ILI) surveillance is to determine the timing, location and magnitude of outbreaks by monitoring the frequency and progression of clinical case incidence. Advances in computational and information technology have allowed for automated collection of higher volumes of electronic data and more timely analyses than previously possible. Novel surveillance systems, including those based on internet search query data like Google Flu Trends (GFT), are being used as surrogates for clinically-based reporting of influenza-like-illness (ILI). We investigated the reliability of GFT during the last decade (2003 to 2013), and compared weekly public health surveillance with search query data to characterize the timing and intensity of seasonal and pandemic influenza at the national (United States), regional (Mid-Atlantic) and local (New York City) levels. We identified substantial flaws in the original and updated GFT models at all three geographic scales, including completely missing the first wave of the 2009 influenza A/H1N1 pandemic, and greatly overestimating the intensity of the A/H3N2 epidemic during the 2012/2013 season. These results were obtained for both the original (2008) and the updated (2009) GFT algorithms. The performance of both models was problematic, perhaps because of changes in internet search behavior and differences in the seasonality, geographical heterogeneity and age-distribution of the epidemics between the periods of GFT model-fitting and prospective use. We conclude that GFT data may not provide reliable surveillance for seasonal or pandemic influenza and should be interpreted with caution until the algorithm can be improved and evaluated. Current internet search query data are no substitute for timely local clinical and laboratory surveillance, or national surveillance based on local data collection. New generation surveillance systems such as GFT should incorporate the use of near-real time electronic health data and computational methods for continued model-fitting and ongoing evaluation and improvement.
Collapse
Affiliation(s)
- Donald R. Olson
- New York City Department of Health and Mental Hygiene, New York, New York, United States of America
| | - Kevin J. Konty
- New York City Department of Health and Mental Hygiene, New York, New York, United States of America
| | - Marc Paladini
- New York City Department of Health and Mental Hygiene, New York, New York, United States of America
| | - Cecile Viboud
- Fogarty International Center, National Institutes of Health, Bethesda, Maryland, United States of America
| | - Lone Simonsen
- Fogarty International Center, National Institutes of Health, Bethesda, Maryland, United States of America
- Department of Global Health, George Washington University, Washington, D.C., United States of America
| |
Collapse
|
49
|
Rosenkötter N, Ziemann A, Riesgo LGC, Gillet JB, Vergeiner G, Krafft T, Brand H. Validity and timeliness of syndromic influenza surveillance during the autumn/winter wave of A (H1N1) influenza 2009: results of emergency medical dispatch, ambulance and emergency department data from three European regions. BMC Public Health 2013; 13:905. [PMID: 24083852 PMCID: PMC3852468 DOI: 10.1186/1471-2458-13-905] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2012] [Accepted: 09/24/2013] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Emergency medical service (EMS) data, particularly from the emergency department (ED), is a common source of information for syndromic surveillance. However, the entire EMS chain, consists of both out-of-hospital and in-hospital services. Differences in validity and timeliness across these data sources so far have not been studied. Neither have the differences in validity and timeliness of this data from different European countries. In this paper we examine the validity and timeliness of the entire chain of EMS data sources from three European regions for common syndromic influenza surveillance during the A(H1N1) influenza pandemic in 2009. METHODS We gathered local, regional, or national information on influenza-like illness (ILI) or respiratory syndrome from an Austrian Emergency Medical Dispatch Service (EMD-AT), an Austrian and Belgian ambulance services (EP-AT, EP-BE) and from a Belgian and Spanish emergency department (ED-BE, ED-ES). We examined the timeliness of the EMS data in identifying the beginning of the autumn/winter wave of pandemic A(H1N1) influenza as compared to the reference data. Additionally, we determined the sensitivity and specificity of an aberration detection algorithm (Poisson CUSUM) in EMS data sources for detecting the autumn/winter wave of the A(H1N1) influenza pandemic. RESULTS The ED-ES data demonstrated the most favourable validity, followed by the ED-BE data. The beginning of the autumn/winter wave of pandemic A(H1N1) influenza was identified eight days in advance in ED-BE data. The EP data performed stronger in data sets for large catchment areas (EP-BE) and identified the beginning of the autumn/winter wave almost at the same time as the reference data (time lag +2 days). EMD data exhibited timely identification of the autumn/winter wave of A(H1N1) but demonstrated weak validity measures. CONCLUSIONS In this study ED data exhibited the most favourable performance in terms of validity and timeliness for syndromic influenza surveillance, along with EP data for large catchment areas. For the other data sources performance assessment delivered no clear results. The study shows that routinely collected data from EMS providers can augment and enhance public health surveillance of influenza by providing information during health crises in which such information must be both timely and readily obtainable.
Collapse
Affiliation(s)
- Nicole Rosenkötter
- Department of International Health, CAPHRI School for Public Health and Primary Care, Faculty for Health, Medicine and Life Sciences, Maastricht University, Duboisdomein 30, Maastricht 6229 GT, The Netherlands
| | - Alexandra Ziemann
- Department of International Health, CAPHRI School for Public Health and Primary Care, Faculty for Health, Medicine and Life Sciences, Maastricht University, Duboisdomein 30, Maastricht 6229 GT, The Netherlands
| | | | - Jean Bernard Gillet
- Department of Emergency Medicine, University Hospital Leuven, Leuven, Belgium
| | | | - Thomas Krafft
- Department of International Health, CAPHRI School for Public Health and Primary Care, Faculty for Health, Medicine and Life Sciences, Maastricht University, Duboisdomein 30, Maastricht 6229 GT, The Netherlands
| | - Helmut Brand
- Department of International Health, CAPHRI School for Public Health and Primary Care, Faculty for Health, Medicine and Life Sciences, Maastricht University, Duboisdomein 30, Maastricht 6229 GT, The Netherlands
| |
Collapse
|
50
|
de Lange MMA, Meijer A, Friesema IHM, Donker GA, Koppeschaar CE, Hooiveld M, Ruigrok N, van der Hoek W. Comparison of five influenza surveillance systems during the 2009 pandemic and their association with media attention. BMC Public Health 2013; 13:881. [PMID: 24063523 PMCID: PMC3849360 DOI: 10.1186/1471-2458-13-881] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2012] [Accepted: 09/16/2013] [Indexed: 11/27/2022] Open
Abstract
Background During the 2009 influenza pandemic period, routine surveillance of influenza-like-illness (ILI) was conducted in The Netherlands by a network of sentinel general practitioners (GPs). In addition during the pandemic period, four other ILI/influenza surveillance systems existed. For pandemic preparedness, we evaluated the performance of the sentinel system and the others to assess which of the four could be useful additions in the future. We also assessed whether performance of the five systems was influenced by media reports during the pandemic period. Methods The trends in ILI consultation rates reported by sentinel GPs from 20 April 2009 through 3 January 2010 were compared with trends in data from the other systems: ILI cases self-reported through the web-based Great Influenza Survey (GIS); influenza-related web searches through Google Flu Trends (GFT); patients admitted to hospital with laboratory-confirmed pandemic influenza, and detections of influenza virus by laboratories. In addition, correlations were determined between ILI consultation rates of the sentinel GPs and data from the four other systems. We also compared the trends of the five surveillance systems with trends in pandemic-related newspaper and television coverage and determined correlation coefficients with and without time lags. Results The four other systems showed similar trends and had strong correlations with the ILI consultation rates reported by sentinel GPs. The number of influenza virus detections was the only system to register a summer peak. Increases in the number of newspaper articles and television broadcasts did not precede increases in activity among the five surveillance systems. Conclusions The sentinel general practice network should remain the basis of influenza surveillance, as it integrates epidemiological and virological information and was able to maintain stability and continuity under pandemic pressure. Hospital and virological data are important during a pandemic, tracking the severity, molecular and phenotypic characterization of the viruses and confirming whether ILI incidence is truly related to influenza virus infections. GIS showed that web-based, self-reported ILI can be a useful addition, especially if virological self-sampling is added and an epidemic threshold could be determined. GFT showed negligible added value.
Collapse
Affiliation(s)
- Marit M A de Lange
- National Institute for Public Health and the Environment (RIVM), Centre for Infectious Disease Control Netherlands, P,O, Box 1, 3720 BA Bilthoven, The Netherlands.
| | | | | | | | | | | | | | | |
Collapse
|