1
|
Deiner MS, Deiner NA, Hristidis V, McLeod SD, Doan T, Lietman TM, Porco TC. Use of Large Language Models to Assess the Likelihood of Epidemics From the Content of Tweets: Infodemiology Study. J Med Internet Res 2024; 26:e49139. [PMID: 38427404 PMCID: PMC10943433 DOI: 10.2196/49139] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2023] [Revised: 12/20/2023] [Accepted: 01/19/2024] [Indexed: 03/02/2024] Open
Abstract
BACKGROUND Previous work suggests that Google searches could be useful in identifying conjunctivitis epidemics. Content-based assessment of social media content may provide additional value in serving as early indicators of conjunctivitis and other systemic infectious diseases. OBJECTIVE We investigated whether large language models, specifically GPT-3.5 and GPT-4 (OpenAI), can provide probabilistic assessments of whether social media posts about conjunctivitis could indicate a regional outbreak. METHODS A total of 12,194 conjunctivitis-related tweets were obtained using a targeted Boolean search in multiple languages from India, Guam (United States), Martinique (France), the Philippines, American Samoa (United States), Fiji, Costa Rica, Haiti, and the Bahamas, covering the time frame from January 1, 2012, to March 13, 2023. By providing these tweets via prompts to GPT-3.5 and GPT-4, we obtained probabilistic assessments that were validated by 2 human raters. We then calculated Pearson correlations of these time series with tweet volume and the occurrence of known outbreaks in these 9 locations, with time series bootstrap used to compute CIs. RESULTS Probabilistic assessments derived from GPT-3.5 showed correlations of 0.60 (95% CI 0.47-0.70) and 0.53 (95% CI 0.40-0.65) with the 2 human raters, with higher results for GPT-4. The weekly averages of GPT-3.5 probabilities showed substantial correlations with weekly tweet volume for 44% (4/9) of the countries, with correlations ranging from 0.10 (95% CI 0.0-0.29) to 0.53 (95% CI 0.39-0.89), with larger correlations for GPT-4. More modest correlations were found for correlation with known epidemics, with substantial correlation only in American Samoa (0.40, 95% CI 0.16-0.81). CONCLUSIONS These findings suggest that GPT prompting can efficiently assess the content of social media posts and indicate possible disease outbreaks to a degree of accuracy comparable to that of humans. Furthermore, we found that automated content analysis of tweets is related to tweet volume for conjunctivitis-related posts in some locations and to the occurrence of actual epidemics. Future work may improve the sensitivity and specificity of these methods for disease outbreak detection.
Collapse
Affiliation(s)
- Michael S Deiner
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
| | - Natalie A Deiner
- College of Letters and Science, University of California, Santa Barbara, Santa Barbara, CA, United States
| | - Vagelis Hristidis
- Department of Computer Science and Engineering, University of California, Riverside, Riverside, CA, United States
| | - Stephen D McLeod
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- American Academy of Ophthalmology, San Francisco, CA, United States
| | - Thuy Doan
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, United States
| | - Thomas M Lietman
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, United States
| | - Travis C Porco
- Department of Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Francis I. Proctor Foundation for Research in Ophthalmology, University of California, San Francisco, San Francisco, CA, United States
- Department of Epidemiology and Biostatistics, University of California, San Francisco, San Francisco, CA, United States
| |
Collapse
|
2
|
Lalitha P, Prajna NV, Gunasekaran R, Teja GV, Sharma SS, Hinterwirth A, Ruder K, Zhong L, Chen C, Deiner M, Huang C, Pinsky BA, Lietman TM, Doan T, Seitzman GD. Deep sequencing analysis of clinical samples from patients with acute infectious conjunctivitis during the COVID-19 delta surge in Madurai, India. J Clin Virol 2022; 157:105318. [PMID: 36242841 PMCID: PMC9534536 DOI: 10.1016/j.jcv.2022.105318] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/12/2022] [Revised: 09/23/2022] [Accepted: 09/30/2022] [Indexed: 11/21/2022]
Abstract
BACKGROUND Seasonal outbreaks of infectious conjunctivitis remain a public health issue. Determination of outbreak etiologies in the context of a worldwide pandemic may provide useful information to guide public health strategies. The aim of this study was to identify pathogens associated with outpatient infectious conjunctivitis during the COVID-19 Delta surge. METHODS This prospective study was conducted from April 2021 to September 2021. All outpatients presenting to the Aravind Eye Center (Madurai, India) with signs and symptoms consistent with acute infectious conjunctivitis were eligible. Three swabs were obtained from each participant: one from each conjunctiva and one from the anterior nares. Samples were processed for metagenomic RNA deep sequencing (RNA-seq). RESULTS Samples from 106 study participants were sequenced. The most common presenting symptoms were tearing (86%) and itching (71%). Preauricular lymphadenopathy was present in 38% of participants. 20% of participants had close contacts with similar symptoms. Systemic symptoms such as coughing, runny nose, vomiting or diarrhea were uncommonly reported. 60% of all participants used some medicated eye drops upon enrollment. 75% of study participants demonstrated infection with human adenovirus D (HAdV-D). 11% of conjunctivitis was associated with SARS-CoV-2. 15% had no definitive pathogen detected. 8% of all participants had codetection of more than one pathogen on RNA-seq. CONCLUSIONS During the COVID-19 Delta surge in India, HAdV-D was the most common pathogen associated with infectious conjunctivitis. SARS-CoV-2 was the second most common associated pathogen. Seasonal surveillance may be necessary for the determination of emerging and reemerging pathogens responsible for infectious conjunctivitis.
Collapse
Affiliation(s)
| | | | | | | | | | - Armin Hinterwirth
- Francis I. Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
| | - Kevin Ruder
- Francis I. Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
| | - Lina Zhong
- Francis I. Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
| | - Cindi Chen
- Francis I. Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
| | - Michael Deiner
- Department of Ophthalmology, University of California, San Francisco, CA, United States
| | - ChunHong Huang
- Department of Pathology, Stanford University School of Medicine, Stanford, CA, United States
| | - Benjamin A Pinsky
- Department of Pathology, Stanford University School of Medicine, Stanford, CA, United States; Department of Medicine, Division of Infectious Diseases and Geographic Medicine, Stanford University School of Medicine, Stanford, CA, United States
| | - Thomas M Lietman
- Francis I. Proctor Foundation, University of California San Francisco, San Francisco, CA, United States; Department of Ophthalmology, University of California, San Francisco, CA, United States
| | - Thuy Doan
- Francis I. Proctor Foundation, University of California San Francisco, San Francisco, CA, United States; Department of Ophthalmology, University of California, San Francisco, CA, United States.
| | - Gerami D Seitzman
- Francis I. Proctor Foundation, University of California San Francisco, San Francisco, CA, United States; Department of Ophthalmology, University of California, San Francisco, CA, United States
| |
Collapse
|
3
|
Deiner MS, Kaur G, McLeod SD, Schallhorn JM, Chodosh J, Hwang DH, Lietman TM, Porco TC. A Google Trends Approach to Identify Distinct Diurnal and Day-of-Week Web-Based Search Patterns Related to Conjunctivitis and Other Common Eye Conditions: Infodemiology Study. J Med Internet Res 2022; 24:e27310. [PMID: 35537041 PMCID: PMC9297131 DOI: 10.2196/27310] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/22/2021] [Revised: 08/18/2021] [Accepted: 05/06/2022] [Indexed: 11/13/2022] Open
Abstract
BACKGROUND Studies suggest diurnal patterns of occurrence of some eye conditions. Leveraging new information sources such as web-based search data to learn more about such patterns could improve the understanding of patients' eye-related conditions and well-being, better inform timing of clinical and remote eye care, and improve precision when targeting web-based public health campaigns toward underserved populations. OBJECTIVE To investigate our hypothesis that the public is likely to consistently search about different ophthalmologic conditions at different hours of the day or days of week, we conducted an observational study using search data for terms related to ophthalmologic conditions such as conjunctivitis. We assessed whether search volumes reflected diurnal or day-of-week patterns and if those patterns were distinct from each other. METHODS We designed a study to analyze and compare hourly search data for eye-related and control search terms, using time series regression models with trend and periodicity terms to remove outliers and then estimate diurnal effects. We planned a Google Trends setting, extracting data from 10 US states for the entire year of 2018. The exposure was internet search, and the participants were populations who searched through Google's search engine using our chosen study terms. Our main outcome measures included cyclical hourly and day-of-week web-based search patterns. For statistical analyses, we considered P<.001 to be statistically significant. RESULTS Distinct diurnal (P<.001 for all search terms) and day-of-week search patterns for eye-related terms were observed but with differing peak time periods and cyclic strengths. Some diurnal patterns represented those reported from prior clinical studies. Of the eye-related terms, "pink eye" showed the largest diurnal amplitude-to-mean ratios. Stronger signal was restricted to and peaked in mornings, and amplitude was higher on weekdays. By contrast, "dry eyes" had a higher amplitude diurnal pattern on weekends, with stronger signal occurring over a broader evening-to-morning period and peaking in early morning. CONCLUSIONS The frequency of web-based searches for various eye conditions can show cyclic patterns according to time of the day or week. Further studies to understand the reasons for these variations may help supplement the current clinical understanding of ophthalmologic symptom presentation and improve the timeliness of patient messaging and care interventions.
Collapse
Affiliation(s)
- Michael S Deiner
- Francis I Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
- Department of Ophthalmology, University of California San Francisco, San Francisco, CA, United States
| | - Gurbani Kaur
- Department of Ophthalmology, University of California San Francisco, San Francisco, CA, United States
- School of Medicine, University of California San Francisco, San Francisco, CA, United States
| | - Stephen D McLeod
- Francis I Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
- Department of Ophthalmology, University of California San Francisco, San Francisco, CA, United States
| | - Julie M Schallhorn
- Francis I Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
- Department of Ophthalmology, University of California San Francisco, San Francisco, CA, United States
| | - James Chodosh
- Department of Ophthalmology, Harvard Medical School, Boston, MA, United States
- Massachusetts Eye and Ear, Harvard Medical School, Boston, MA, United States
| | - Daniel H Hwang
- Stanford University, San Mateo, CA, United States
- The Nueva School, San Mateo, CA, United States
| | - Thomas M Lietman
- Francis I Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
- Department of Ophthalmology, University of California San Francisco, San Francisco, CA, United States
- Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, CA, United States
- Global Health Sciences, University of California San Francisco, San Francisco, CA, United States
| | - Travis C Porco
- Francis I Proctor Foundation, University of California San Francisco, San Francisco, CA, United States
- Department of Ophthalmology, University of California San Francisco, San Francisco, CA, United States
- Department of Epidemiology and Biostatistics, University of California San Francisco, San Francisco, CA, United States
- Global Health Sciences, University of California San Francisco, San Francisco, CA, United States
| |
Collapse
|
4
|
Bountogo M, Sié A, Coulibaly B, Ruder K, Chen C, Zhong L, Colby E, Lebas E, Deiner M, Hinterwirth A, Lietman TM, Seitzman GD, Doan T. Deep sequencing analysis of acute conjunctivitis in Burkina Faso, Africa. Int Health 2022; 15:101-103. [PMID: 35076074 PMCID: PMC9808514 DOI: 10.1093/inthealth/ihac001] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2021] [Revised: 12/28/2021] [Accepted: 01/06/2022] [Indexed: 01/07/2023] Open
Abstract
BACKGROUND Seasonal and epidemic conjunctivitis (pink eye) infections are highly contagious and impose a significant economic burden worldwide. Long-term visual impairment can occur. METHODS This study used metagenomic deep sequencing to evaluate pathogens causing acute infectious conjunctivitis in Burkina Faso. RESULTS We found that pathogens causing conjunctivitis in Burkina Faso are diverse, with human adenoviruses responsible for a small fraction of the samples tested. CONCLUSIONS These results are unexpected and suggest the importance of regional surveillance.
Collapse
Affiliation(s)
- Mamadou Bountogo
- Centre de Recherche en Sante de Nouna, Rue Namory Keita, BP02, Nouna, Burkina Faso
| | - Ali Sié
- Centre de Recherche en Sante de Nouna, Rue Namory Keita, BP02, Nouna, Burkina Faso
| | - Boubacar Coulibaly
- Centre de Recherche en Sante de Nouna, Rue Namory Keita, BP02, Nouna, Burkina Faso
| | - Kevin Ruder
- F. I. Proctor Foundation, University of California San Francisco, 490 Illinois Street, Floor 2, San Francisco, CA 94158, USA
| | - Cindi Chen
- F. I. Proctor Foundation, University of California San Francisco, 490 Illinois Street, Floor 2, San Francisco, CA 94158, USA
| | - Lina Zhong
- F. I. Proctor Foundation, University of California San Francisco, 490 Illinois Street, Floor 2, San Francisco, CA 94158, USA
| | - Emily Colby
- F. I. Proctor Foundation, University of California San Francisco, 490 Illinois Street, Floor 2, San Francisco, CA 94158, USA
| | - Elodie Lebas
- F. I. Proctor Foundation, University of California San Francisco, 490 Illinois Street, Floor 2, San Francisco, CA 94158, USA
| | - Michael Deiner
- Department of Ophthalmology, University of California San Francisco, 490 Illinois Street, San Francisco, CA 94158, USA
| | - Armin Hinterwirth
- F. I. Proctor Foundation, University of California San Francisco, 490 Illinois Street, Floor 2, San Francisco, CA 94158, USA
| | - Thomas M Lietman
- F. I. Proctor Foundation, University of California San Francisco, 490 Illinois Street, Floor 2, San Francisco, CA 94158, USA,Department of Ophthalmology, University of California San Francisco, 490 Illinois Street, San Francisco, CA 94158, USA
| | - Gerami D Seitzman
- F. I. Proctor Foundation, University of California San Francisco, 490 Illinois Street, Floor 2, San Francisco, CA 94158, USA,Department of Ophthalmology, University of California San Francisco, 490 Illinois Street, San Francisco, CA 94158, USA
| | - Thuy Doan
- Corresponding author: Tel: 1-415-476-6939; E-mail:
| |
Collapse
|
5
|
Kaur G, Seitzman GD, Lietman TM, McLeod SD, Porco TC, Doan T, Deiner MS. Keeping an eye on pink eye: a global conjunctivitis outbreak expert survey. Int Health 2021; 14:542-544. [PMID: 34409991 PMCID: PMC9450638 DOI: 10.1093/inthealth/ihab049] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Revised: 07/20/2021] [Accepted: 07/29/2021] [Indexed: 11/15/2022] Open
Abstract
BACKGROUND Recurrent conjunctivitis epidemics are prevalent worldwide. Aetiologies are often undetermined. METHODS We surveyed conjunctivitis researchers about perceived trends in prevalence, incidence and aetiologies of conjunctivitis epidemics. RESULTS Of the 155 participants, 7% endorsed globally variable and dynamic microbial aetiologies of conjunctivitis epidemics. Increased incidence of conjunctivitis epidemics over the last decade were reported by 21% of respondents. Peak seasons differed between the northern and southern hemispheres. CONCLUSIONS There is regional equipoise regarding the increasing incidence and emerging underlying aetiologies of epidemic conjunctivitis. Further investigation of global surveillance and microbial characterization of conjunctivitis outbreaks could improve prevention and outcomes.
Collapse
Affiliation(s)
- Gurbani Kaur
- University of California, San Francisco School of Medicine, San Francisco, CA 94143, USA.,University of California, San Francisco Department of Ophthalmology, San Francisco, CA 94158, USA
| | - Gerami D Seitzman
- University of California, San Francisco Department of Ophthalmology, San Francisco, CA 94158, USA.,Francis I. Proctor Foundation for Research in Ophthalmology, San Francisco, CA 94158, USA
| | - Thomas M Lietman
- University of California, San Francisco Department of Ophthalmology, San Francisco, CA 94158, USA.,Francis I. Proctor Foundation for Research in Ophthalmology, San Francisco, CA 94158, USA
| | - Stephen D McLeod
- University of California, San Francisco Department of Ophthalmology, San Francisco, CA 94158, USA.,Francis I. Proctor Foundation for Research in Ophthalmology, San Francisco, CA 94158, USA
| | - Travis C Porco
- University of California, San Francisco Department of Ophthalmology, San Francisco, CA 94158, USA.,Francis I. Proctor Foundation for Research in Ophthalmology, San Francisco, CA 94158, USA
| | - Thuy Doan
- University of California, San Francisco Department of Ophthalmology, San Francisco, CA 94158, USA.,Francis I. Proctor Foundation for Research in Ophthalmology, San Francisco, CA 94158, USA
| | - Michael S Deiner
- University of California, San Francisco Department of Ophthalmology, San Francisco, CA 94158, USA.,Francis I. Proctor Foundation for Research in Ophthalmology, San Francisco, CA 94158, USA
| |
Collapse
|
6
|
Google Searches and Detection of Conjunctivitis Epidemics Worldwide. Ophthalmology 2019; 126:1219-1229. [PMID: 30981915 DOI: 10.1016/j.ophtha.2019.04.008] [Citation(s) in RCA: 34] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2018] [Revised: 03/15/2019] [Accepted: 04/05/2019] [Indexed: 11/22/2022] Open
Abstract
PURPOSE Epidemic and seasonal infectious conjunctivitis outbreaks can impact education, workforce, and economy adversely. Yet conjunctivitis typically is not a reportable disease, potentially delaying mitigating intervention. Our study objective was to determine if conjunctivitis epidemics could be identified using Google Trends search data. DESIGN Search data for conjunctivitis-related and control search terms from 5 years and countries worldwide were obtained. Country and term were masked. Temporal scan statistics were applied to identify candidate epidemics. Candidates then were assessed for geotemporal concordance with an a priori defined collection of known reported conjunctivitis outbreaks, as a measure of sensitivity. PARTICIPANTS Populations by country that searched Google's search engine using our study terms. MAIN OUTCOME MEASURES Percent of known conjunctivitis outbreaks also found in the same country and period by our candidate epidemics, identified from conjunctivitis-related searches. RESULTS We identified 135 candidate conjunctivitis epidemic periods from 77 countries. Compared with our a priori defined collection of known reported outbreaks, candidate conjunctivitis epidemics identified 18 of 26 (69% sensitivity) of the reported country-wide or island nationwide outbreaks, or both; 9 of 20 (45% sensitivity) of the reported region or district-wide outbreaks, or both; but far fewer nosocomial and reported smaller outbreaks. Similar overall and individual sensitivity, as well as specificity, were found on a country-level basis. We also found that 83% of our candidate epidemics had start dates before (of those, 20% were more than 12 weeks before) their concurrent reported outbreak's report issuance date. Permutation tests provided evidence that on average, conjunctivitis candidate epidemics occurred geotemporally closer to outbreak reports than chance alone suggests (P < 0.001) unlike control term candidates (P = 0.40). CONCLUSIONS Conjunctivitis outbreaks can be detected using temporal scan analysis of Google search data alone, with more than 80% detected before an outbreak report's issuance date, some as early as the reported outbreak's start date. Future approaches using data from smaller regions, social media, and more search terms may improve sensitivity further and cross-validate detected candidates, allowing identification of candidate conjunctivitis epidemics from Internet search data potentially to complementarily benefit traditional reporting and detection systems to improve epidemic awareness.
Collapse
|